00000001:02000400:0.0F:1788636401.642327:0:3303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788636419.346356:0:3523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788636421.006004:0:3582:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 607 MB/s 00000001:01000000:3.0:1788636421.256469:0:3582:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 675 MB/s 00000001:01000000:0.0:1788636421.505964:0:3582:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4719 MB/s 00000020:02000000:1.0F:1788636422.270647:0:3614:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g6837bc1 00000400:02000000:1.0:1788636423.373404:0:3629:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.126@tcp [8/256/0/180] 00008000:02000000:1.0:1788636426.849445:0:3779:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788636494.698512:0:5748:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788636509.348148:0:6498:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788636509.348160:0:6498:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788636509.348161:0:6498:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788636509.348607:0:6498:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ff1be3ad 00000080:02000400:3.0:1788636509.348626:0:6498:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788636509.353571:0:6498:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788636509.353589:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788636509.353635:0:6498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000048455567) 00000020:00000080:3.0:1788636509.353663:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788636509.410749:0:6498:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788636509.411286:0:6498:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788636509.442024:0:6498:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788636509.442405:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788636509.442417:0:6498:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788636509.442496:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e837d15 00000020:01000004:0.0:1788636509.442563:0:6498:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788636509.442569:0:6498:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788636509.442575:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ff1be3ad from MGS 00000020:01000004:0.0:1788636509.442581:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788636509.442684:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000083fb77aa) 00000020:00000080:0.0:1788636509.442707:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788636509.443024:0:6498:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ff1be3ad from MGS, refs=2 00080000:01000000:0.0:1788636509.443034:0:6498:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788636509.443043:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e837d23 00000100:00100000:0.0:1788636509.443182:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788636509.444053:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788636509.444065:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788636509.447113:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788636509.447139:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788636509.450605:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636509.450904:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788636509.450912:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788636509.455922:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788636509.456033:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788636509.463207:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788636509.463234:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788636509.471843:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636509.471852:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636509.471856:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636509.473528:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636509.473533:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636509.473535:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636509.474450:0:6498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788636509.480430:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788636509.726093:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2611 MB/s 00000001:01000000:0.0:1788636509.976894:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2832 MB/s 00000001:01000000:0.0:1788636510.227104:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 595 MB/s 00000001:01000000:2.0F:1788636510.479658:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 599 MB/s 00010000:00010000:0.0:1788636510.486589:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788636510.497771:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788636510.517345:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788636510.518457:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788636510.518609:0:6498:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788636510.518650:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788636510.518865:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788636510.518888:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788636510.519350:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636510.519736:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788636510.519744:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788636510.522891:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788636510.522906:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788636510.523418:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788636510.523424:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788636510.546196:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788636510.546223:0:6498:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.126@tcp' 00000020:01000004:2.0:1788636510.546225:0:6498:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788636510.546284:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.126@tcp (typ=mgc) 00000020:00000080:2.0:1788636510.546304:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.126@tcp (000000009ef78f22) 00000020:00000080:2.0:1788636510.546325:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:1.0:1788636510.546677:0:6517:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:2.0:1788636510.546742:0:6498:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b7df99ef@MGC192.168.202.126@tcp: add connection 192.168.202.126@tcp at head 00010000:00010000:2.0:1788636510.546964:0:6498:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.126@tcp-0 is initialized 00000040:01000000:2.0:1788636510.546972:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.126@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788636510.554979:0:6519:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788636510.555088:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.126@tcp (uuid 2c4a4b8e-4887-46f1-83c2-b9af7c6766da) 00000020:00000080:2.0:1788636510.555129:0:6498:0:(genops.c:1385:class_connect()) connect: client 2c4a4b8e-4887-46f1-83c2-b9af7c6766da, cookie 0x5b741ef42e837d31 00000100:00080000:2.0:1788636510.555144:0:6498:0:(import.c:545:import_select_connection()) MGC192.168.202.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788636510.555150:0:6498:0:(import.c:665:import_select_connection()) MGC192.168.202.126@tcp: import 00000000b7df99ef using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636510.555214:0:6498:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007f63c19c x1875521225883776/t0(0) o250->MGC192.168.202.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788636510.555241:0:6498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2c4a4b8e-4887-46f1-83c2-b9af7c6766da->MGS 00000020:01000004:2.0:1788636510.555271:0:6498:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788636510.555279:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788636510.555297:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008170e0e1) 00000020:00000080:2.0:1788636510.555311:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788636510.557342:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007f63c19c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3645:1875521225883776:0@lo:250: 00000100:00100000:0.0:1788636510.557467:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636510.557594:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225883776 00000100:00100000:0.0:1788636510.557608:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225883776 00000100:00100000:0.0:1788636510.557645:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636510.557651:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003f88d12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1875521225883776:12345-0@lo:250: 00010000:00080000:0.0:1788636510.557678:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2c4a4b8e-4887-46f1-83c2-b9af7c6766da@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1788636510.557709:0:6513:0:(genops.c:1385:class_connect()) connect: client 2c4a4b8e-4887-46f1-83c2-b9af7c6766da, cookie 0x5b741ef42e837d3f 00000100:00080000:0.0:1788636510.557902:0:6513:0:(import.c:65:import_set_state_nolock()) 000000007977dc31 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636510.557970:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003f88d12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:3645:x1875521225883776:12345-0@lo:250: Request processed in 317us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636510.557979:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636510.567882:0:3645:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788636510.567904:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.126@tcp: connect to target with instance 0 00000100:00080000:0.0:1788636510.567913:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788636510.567921:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788636510.567925:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000b7df99ef MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788636510.567931:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788636510.567943:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788636510.567950:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007f63c19c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3645:1875521225883776:0@lo:250: 00000100:00100000:2.0:1788636510.598487:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636510.598730:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788636510.598738:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788636510.600480:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788636510.600491:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788636510.610986:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788636510.611009:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788636510.616735:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636510.617008:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788636510.617017:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788636510.623404:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788636510.623474:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788636510.722109:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636510.725571:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788636510.725587:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788636510.727664:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788636510.727685:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788636510.731611:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636510.731912:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788636510.731919:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788636510.736205:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788636510.736225:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788636510.738635:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636510.738949:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788636510.738959:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788636510.739699:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788636510.739706:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788636510.744902:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636510.745091:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788636510.745098:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788636510.747694:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788636510.747713:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788636510.783018:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636510.783851:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788636510.783860:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788636510.785856:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788636510.785875:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788636510.787784:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788636510.787800:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788636510.791964:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788636510.792003:0:6498:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788636510.792018:0:6498:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788636510.792239:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788636510.792284:0:6498:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.126@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788636510.792288:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788636510.792290:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636510.792291:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636510.792293:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636510.792294:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636510.792295:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636510.792297:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636510.792298:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636510.792300:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788636510.792301:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788636510.792303:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636510.792304:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788636510.792307:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788636510.792309:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788636510.792396:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636510.792398:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636510.792399:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636510.792400:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636510.792401:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636510.792402:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636510.792403:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636510.792404:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788636510.792405:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788636510.792406:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636510.792407:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788636510.792522:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788636510.792545:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000147a549 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225883904:0@lo:253: 00000100:00100000:0.0:1788636510.792649:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636510.792765:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000000448f541 going to sleep for 11 seconds 00000100:00100000:3.0:1788636510.792921:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225883904 00000100:00100000:3.0:1788636510.792931:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225883904 00000100:00100000:3.0:1788636510.793035:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636510.793045:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b89d431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:6498:x1875521225883904:12345-0@lo:253: 20000000:01000000:3.0:1788636510.793108:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788636510.793113:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788636510.793592:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788636510.793654:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788636510.794081:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636510.797091:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788636510.797896:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788636510.797901:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788636510.797910:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788636510.797913:0:6516:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788636510.797924:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788636510.798184:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636510.798380:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788636510.798394:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788636510.798411:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788636510.798423:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788636510.798434:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788636510.798485:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788636510.798492:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788636510.798502:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788636510.798507:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788636510.798524:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788636510.798528:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788636510.798538:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788636510.798549:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788636510.798579:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788636510.798584:0:6516:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788636510.798589:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636510.798678:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788636510.798686:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788636510.798698:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788636510.798709:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788636510.798721:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788636510.798729:0:6516:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788636510.798748:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788636510.798767:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788636510.798779:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788636510.798792:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788636510.798803:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788636510.798840:0:6516:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788636510.798860:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788636510.798866:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788636510.798876:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788636510.798888:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788636510.798946:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788636510.798965:0:6516:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788636510.798984:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788636510.800252:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788636510.800643:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788636510.800681:0:6516:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.126@tcp for mdt 20000000:01000000:2.0:1788636510.800684:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788636510.800702:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788636510.800708:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788636510.800721:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788636510.800727:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.126@tcp (null) (null) 00000040:00080000:2.0:1788636510.800738:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788636510.800746:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788636510.800772:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788636510.800788:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788636510.800922:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788636510.800926:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788636510.800932:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788636510.800996:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788636510.800999:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788636510.801627:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788636510.801991:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788636510.802017:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788636510.802050:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1788636510.802068:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788636510.802070:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788636510.802594:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788636510.802777:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788636510.802800:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788636510.802944:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1788636510.802956:0:6516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788636510.802959:0:6516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788636510.802963:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788636510.802966:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788636510.802972:0:6516:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788636510.802979:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788636510.803469:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788636510.803596:0:6516:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788636510.813641:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788636510.813685:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788636510.813702:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788636510.813722:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788636510.813745:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.813774:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.813991:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.814000:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.814006:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.814012:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.814018:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000047717b18 already unused, calling callback (00000000ea3c6fd1) 00010000:00010000:3.0:1788636510.814022:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.814031:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.814046:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.814053:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.814059:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047717b18/0x5b741ef42e837d46 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788636510.814078:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788636510.833683:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b89d431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:6498:x1875521225883904:12345-0@lo:253: Request processed in 40626us (41022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636510.833725:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636510.836448:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000147a549 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225883904:0@lo:253: 10000000:01000000:0.0:1788636510.836517:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788636510.836522:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788636510.836525:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636510.836527:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636510.836528:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788636510.836529:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636510.836530:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636510.836531:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636510.836533:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636510.836535:0:6498:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788636510.836536:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636510.836538:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788636510.837050:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ff1be3ad from lustre-MDT0000 10000000:01000000:1.0:1788636510.837125:0:6498:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788636510.837130:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788636510.837136:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cf040b3b380 10000000:01000000:1.0:1788636510.837141:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636510.837150:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf040b3b380 from 1 10000000:01000000:1.0:1788636510.837152:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788636510.837207:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.837218:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.837226:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636510.837244:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084778fe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884032:0@lo:101: 00000100:00100000:1.0:1788636510.837345:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636510.837405:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7c53332 going to sleep for 11 seconds 00000100:00100000:2.0:1788636510.837483:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225884032 00000100:00100000:2.0:1788636510.837492:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225884032 00000100:00100000:2.0:1788636510.837545:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788636510.837554:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2b90d43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:6498:x1875521225884032:12345-0@lo:101: 00010000:00010000:2.0:1788636510.837569:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636510.837584:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000417ae2f5/0x5b741ef42e837d54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837d4d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.837612:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000417ae2f5/0x5b741ef42e837d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837d4d expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.837622:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000417ae2f5/0x5b741ef42e837d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837d4d expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.837632:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000417ae2f5, rc 0) 00000100:00100000:2.0:1788636510.837683:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2b90d43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+6:6498:x1875521225884032:12345-0@lo:101: Request processed in 130us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636510.837701:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788636510.837977:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084778fe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884032:0@lo:101: 00010000:00010000:1.0:1788636510.837990:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.838009:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636510.838069:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084778fe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884160:0@lo:501: 00000100:00100000:1.0:1788636510.838092:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636510.838120:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7c53332 going to sleep for 11 seconds 00000100:00100000:0.0:1788636510.838252:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225884160 00000100:00100000:0.0:1788636510.838257:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225884160 00000100:00100000:0.0:1788636510.838292:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636510.838299:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031b52aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+6:6498:x1875521225884160:12345-0@lo:501: 00000100:00100000:0.0:1788636510.838401:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031b52aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+6:6498:x1875521225884160:12345-0@lo:501: Request processed in 102us (308us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636510.838408:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636510.838546:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084778fe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884160:0@lo:501: 10000000:01000000:1.0:1788636510.838579:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788636510.838595:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.838603:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636510.838612:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf00324c000 10000000:01000000:1.0:1788636510.838616:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788636510.838621:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cf00324c000 10000000:01000000:1.0:1788636510.838623:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788636510.838626:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cf00324c000 from 1 10000000:01000000:1.0:1788636510.838627:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788636510.838645:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 0000000080cc495a/0x5b741ef42e837d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.838652:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 0000000080cc495a/0x5b741ef42e837d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.838659:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 0000000080cc495a/0x5b741ef42e837d5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636510.838685:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084778fe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884288:0@lo:101: 00000100:00100000:1.0:1788636510.838712:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636510.838737:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7c53332 going to sleep for 11 seconds 00000100:00100000:2.0:1788636510.838867:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225884288 00000100:00100000:2.0:1788636510.838872:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225884288 00000100:00100000:2.0:1788636510.838896:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636510.838902:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a03b6ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+6:6498:x1875521225884288:12345-0@lo:101: 00010000:00010000:2.0:1788636510.838911:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636510.838926:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052b3d458/0x5b741ef42e837d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837d5b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.838945:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052b3d458/0x5b741ef42e837d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837d5b expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.838955:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052b3d458/0x5b741ef42e837d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837d5b expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.838964:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052b3d458, rc 0) 00000100:00100000:2.0:1788636510.838994:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a03b6ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+7:6498:x1875521225884288:12345-0@lo:101: Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636510.839000:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636510.839148:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084778fe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884288:0@lo:101: 00010000:00010000:1.0:1788636510.839159:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 0000000080cc495a/0x5b741ef42e837d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.839166:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 0000000080cc495a/0x5b741ef42e837d5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636510.839178:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788636510.839182:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 0000000080cc495a/0x5b741ef42e837d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.839188:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 0000000080cc495a/0x5b741ef42e837d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636510.839195:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788636510.839198:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636510.839202:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cf00324c000 10000000:01000000:1.0:1788636510.839205:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788636510.839208:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788636510.839210:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788636510.839224:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.839230:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.839246:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636510.839258:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084778fe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884416:0@lo:101: 00000100:00100000:1.0:1788636510.839286:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636510.839323:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7c53332 going to sleep for 11 seconds 00000100:00100000:2.0:1788636510.839502:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225884416 00000100:00100000:2.0:1788636510.839507:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225884416 00000100:00100000:2.0:1788636510.839533:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636510.839539:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009518030b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+7:6498:x1875521225884416:12345-0@lo:101: 00010000:00010000:2.0:1788636510.839546:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636510.839556:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000073865ccf/0x5b741ef42e837d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837d69 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.839570:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073865ccf/0x5b741ef42e837d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837d69 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.839587:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000073865ccf/0x5b741ef42e837d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837d69 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.839592:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000073865ccf, rc 0) 00000100:00100000:2.0:1788636510.839629:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009518030b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+8:6498:x1875521225884416:12345-0@lo:101: Request processed in 91us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636510.839635:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636510.839772:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084778fe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884416:0@lo:101: 00010000:00010000:1.0:1788636510.839782:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636510.839789:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636510.839980:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084778fe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884544:0@lo:501: 00000100:00100000:1.0:1788636510.840008:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636510.840079:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d7c53332 going to sleep for 11 seconds 00000100:00100000:0.0:1788636510.842646:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225884544 00000100:00100000:0.0:1788636510.842666:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225884544 00000100:00100000:1.0:1788636510.843272:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788636510.843283:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5530799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+8:6498:x1875521225884544:12345-0@lo:501: 00000100:00100000:1.0:1788636510.843532:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5530799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:6498:x1875521225884544:12345-0@lo:501: Request processed in 251us (3524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636510.843540:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636510.843653:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084778fe5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884544:0@lo:501: 00000100:00100000:3.0:1788636510.843736:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000350445d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884672:0@lo:503: 00000100:00100000:3.0:1788636510.843802:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.844221:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e33d3a58 going to sleep for 11 seconds 00000100:00100000:2.0:1788636510.844540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225884672 00000100:00100000:2.0:1788636510.844549:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225884672 00000100:00100000:2.0:1788636510.844590:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636510.844597:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051b226b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:6498:x1875521225884672:12345-0@lo:503: 00000100:00100000:2.0:1788636510.844728:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051b226b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:6498:x1875521225884672:12345-0@lo:503: Request processed in 131us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636510.844736:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636510.844931:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000350445d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225884672:0@lo:503: 00000100:00100000:3.0:1788636510.847690:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000350445d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6543:1875521225884800:0@lo:502: 00000100:00100000:3.0:1788636510.847867:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.847914:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061952365 going to sleep for 11 seconds 00000100:00100000:1.0:1788636510.848290:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225884800 00000100:00100000:1.0:1788636510.848298:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225884800 00000100:00100000:1.0:1788636510.848362:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788636510.848370:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0998ded pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:6543:x1875521225884800:12345-0@lo:502: 00000100:00100000:1.0:1788636510.848521:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0998ded pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:6543:x1875521225884800:12345-0@lo:502: Request processed in 151us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636510.848537:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788636510.848599:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000350445d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6543:1875521225884800:0@lo:502: 00000020:01000000:1.0:1788636510.848637:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636510.848662:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636510.848666:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788636510.848671:0:6543:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788636510.848674:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636510.848695:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f03612a6) 00000020:00000080:1.0:1788636510.848714:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788636510.848722:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788636510.848870:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788636510.848880:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e837d7e 00000020:00000080:1.0:1788636510.849254:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788636510.849259:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636510.849264:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636510.849265:0:6543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788636510.849268:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636510.849271:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636510.849272:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788636510.849276:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636510.849282:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004a8c7baf) 00000020:00000080:1.0:1788636510.849294:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788636510.849297:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788636510.849299:0:6543:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788636510.849301:0:6543:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788636510.849307:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788636510.849545:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ff1be3ad from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788636510.849561:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000bcccae2c) 00000020:00000080:1.0:1788636510.849585:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788636510.849831:0:6543:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788636510.849838:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e837d93 00000020:00000080:1.0:1788636510.850284:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788636510.850294:0:6543:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788636510.850300:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5b741ef42e837d9a 00080000:01000000:1.0:1788636510.850306:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788636510.850310:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e837da1 00080000:10000000:1.0:1788636510.852334:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788636510.852547:0:6543:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788636510.856300:0:6543:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788636510.930046:0:6543:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788636510.930431:0:6543:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788636510.935519:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788636510.936194:0:6543:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788636510.940761:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fdc68db5) 00000020:00000080:3.0:1788636510.940789:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788636510.940953:0:6543:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788636510.940961:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e837daf 00000020:00000080:0.0:1788636510.941597:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788636510.942733:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788636510.948999:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788636510.952198:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788636510.958381:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788636510.962183:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788636510.964209:0:6543:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1788636510.966225:0:6543:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5b741ef42e837db6 00000020:00000080:0.0:1788636510.966602:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788636510.966620:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636510.966628:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636510.966630:0:6543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788636510.966633:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636510.966638:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636510.966640:0:6543:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788636510.966643:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788636510.966645:0:6543:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788636510.966654:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636510.966657:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636510.966658:0:6543:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788636510.966662:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636510.966668:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636510.966669:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788636510.966674:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788636510.966729:0:6543:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788636510.967104:0:6543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000147a549 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6543:1875521225884928:0@lo:502: 00000100:00100000:1.0:1788636510.967511:0:6543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636510.967573:0:6543:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018cd7cd4 going to sleep for 11 seconds 00000100:00100000:2.0:1788636510.967641:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225884928 00000100:00100000:2.0:1788636510.967650:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225884928 00000100:00100000:2.0:1788636510.967702:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636510.967710:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071a00401 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:6543:x1875521225884928:12345-0@lo:502: 00000100:00100000:2.0:1788636510.967882:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071a00401 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:6543:x1875521225884928:12345-0@lo:502: Request processed in 172us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636510.967889:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636510.968030:0:6543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000147a549 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6543:1875521225884928:0@lo:502: 00000020:01000000:1.0:1788636510.968059:0:6543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636510.968065:0:6543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636510.968067:0:6543:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788636510.968071:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788636510.968241:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788636510.968280:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788636510.968304:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.968316:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636510.968326:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf00324c000 from 1 10000000:01000000:2.0:1788636510.968329:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788636510.968370:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.968379:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636510.968390:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636510.968408:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e913b66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885056:0@lo:101: 00000100:00100000:2.0:1788636510.968444:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636510.968474:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be46c19f going to sleep for 11 seconds 00000100:00100000:0.0:1788636510.968679:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225885056 00000100:00100000:0.0:1788636510.968686:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225885056 00000100:00100000:0.0:1788636510.968765:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636510.968773:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019681075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:6498:x1875521225885056:12345-0@lo:101: 00010000:00010000:0.0:1788636510.968785:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636510.968802:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837dc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837dbd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636510.968863:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837dbd expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636510.968874:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837dbd expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636510.968884:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001b4d6f11, rc 0) 00000100:00100000:0.0:1788636510.968933:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019681075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:6498:x1875521225885056:12345-0@lo:101: Request processed in 161us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636510.968939:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636510.969016:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e913b66d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885056:0@lo:101: 00010000:00010000:3.0:1788636510.969032:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.969041:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636510.969614:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885184:0@lo:256: 00000100:00100000:3.0:1788636510.969664:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.970054:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a3a3c59 going to sleep for 11 seconds 00000100:00100000:2.0:1788636510.970132:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225885184 00000100:00100000:2.0:1788636510.970139:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225885184 00000100:00100000:2.0:1788636510.970176:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636510.970185:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002888a9f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:6498:x1875521225885184:12345-0@lo:256: 20000000:01000000:2.0:1788636510.970207:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788636510.970215:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788636510.970300:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002888a9f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:6498:x1875521225885184:12345-0@lo:256: Request processed in 116us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636510.970308:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788636510.970403:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885184:0@lo:256: 10000000:01000000:3.0:1788636510.971024:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788636510.971733:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.971745:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636510.971764:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00324c000 from 1 10000000:01000000:3.0:1788636510.971767:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636510.971840:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.971847:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.971857:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636510.971880:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885312:0@lo:101: 00000100:00100000:3.0:1788636510.971960:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.971985:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a3a3c59 going to sleep for 11 seconds 00000100:00100000:0.0:1788636510.972210:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225885312 00000100:00100000:0.0:1788636510.972218:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225885312 00000100:00100000:0.0:1788636510.972263:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788636510.972282:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2764aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:6498:x1875521225885312:12345-0@lo:101: 00010000:00010000:0.0:1788636510.972297:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636510.972312:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c6ef95d0/0x5b741ef42e837dd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837dcb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636510.972337:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c6ef95d0/0x5b741ef42e837dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837dcb expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636510.972349:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c6ef95d0/0x5b741ef42e837dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837dcb expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636510.972357:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c6ef95d0, rc 0) 00000100:00100000:0.0:1788636510.972408:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2764aec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:6498:x1875521225885312:12345-0@lo:101: Request processed in 127us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636510.972416:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636510.972567:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885312:0@lo:101: 00010000:00010000:3.0:1788636510.972585:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.972595:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636510.972675:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885440:0@lo:501: 00000100:00100000:3.0:1788636510.972706:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.972748:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a3a3c59 going to sleep for 11 seconds 00000100:00100000:2.0:1788636510.972992:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225885440 00000100:00100000:2.0:1788636510.972997:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225885440 00000100:00100000:2.0:1788636510.973023:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636510.973030:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075b84f0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:6498:x1875521225885440:12345-0@lo:501: 00000100:00100000:2.0:1788636510.973206:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075b84f0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:6498:x1875521225885440:12345-0@lo:501: Request processed in 176us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636510.973214:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636510.973313:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885440:0@lo:501: 00000100:00100000:3.0:1788636510.973362:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885568:0@lo:503: 00000100:00100000:3.0:1788636510.973402:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.973431:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a3a3c59 going to sleep for 11 seconds 00000100:00100000:0.0:1788636510.973486:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225885568 00000100:00100000:0.0:1788636510.973491:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225885568 00000100:00100000:0.0:1788636510.973509:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788636510.973513:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5566595 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:6498:x1875521225885568:12345-0@lo:503: 00000040:00080000:0.0:1788636510.973549:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788636510.973591:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5566595 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:6498:x1875521225885568:12345-0@lo:503: Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636510.973598:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788636510.973702:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885568:0@lo:503: 00000040:00080000:0.0:1788636510.975627:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788636510.976196:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788636510.976225:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636510.976276:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.976289:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636510.976349:0:6498:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788636510.976353:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf00324c000 10000000:01000000:3.0:1788636510.976356:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf00324c000 10000000:01000000:3.0:1788636510.976361:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788636510.976369:0:6498:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00324c000 from 1 10000000:01000000:3.0:1788636510.976373:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788636510.976420:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.976428:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.976439:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636510.976467:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885696:0@lo:101: 00000100:00100000:3.0:1788636510.976578:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.976622:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000daf9ddd6 going to sleep for 11 seconds 00000100:00100000:0.0:1788636510.976698:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225885696 00000100:00100000:0.0:1788636510.976705:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225885696 00000100:00100000:0.0:1788636510.976804:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788636510.976835:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002073b572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:6498:x1875521225885696:12345-0@lo:101: 00010000:00010000:0.0:1788636510.976931:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636510.976954:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009221780e/0x5b741ef42e837de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837dd9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636510.976985:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009221780e/0x5b741ef42e837de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837dd9 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636510.976997:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009221780e/0x5b741ef42e837de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837dd9 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636510.977005:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009221780e, rc 0) 00000100:00100000:0.0:1788636510.977055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002073b572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6498:x1875521225885696:12345-0@lo:101: Request processed in 222us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636510.977062:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636510.977203:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885696:0@lo:101: 00010000:00010000:3.0:1788636510.977217:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.977226:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636510.977279:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885824:0@lo:501: 00000100:00100000:3.0:1788636510.977306:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.977411:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000daf9ddd6 going to sleep for 11 seconds 00000100:00100000:1.0:1788636510.977475:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225885824 00000100:00100000:1.0:1788636510.977481:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225885824 00000100:00100000:1.0:1788636510.977509:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788636510.977515:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4714958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6498:x1875521225885824:12345-0@lo:501: 00000100:00100000:1.0:1788636510.977668:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4714958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6498:x1875521225885824:12345-0@lo:501: Request processed in 153us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636510.977676:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788636510.977761:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885824:0@lo:501: 00000100:00100000:3.0:1788636510.977792:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885952:0@lo:503: 00000100:00100000:3.0:1788636510.977878:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.977894:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 00000000daf9ddd6 going to sleep for 11 seconds 00000100:00100000:1.0:1788636510.978024:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225885952 00000100:00100000:1.0:1788636510.978029:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225885952 00000100:00100000:1.0:1788636510.978057:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788636510.978063:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097971516 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6498:x1875521225885952:12345-0@lo:503: 00000100:00100000:1.0:1788636510.978154:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097971516 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6498:x1875521225885952:12345-0@lo:503: Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636510.978160:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788636510.978244:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225885952:0@lo:503: 00000100:00100000:3.0:1788636510.979053:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6548:1875521225886080:0@lo:502: 00000100:00100000:3.0:1788636510.979103:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.979162:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set 00000000daf9ddd6 going to sleep for 11 seconds 00000100:00100000:1.0:1788636510.979199:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225886080 00000100:00100000:1.0:1788636510.979205:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225886080 00000100:00100000:1.0:1788636510.979263:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788636510.979270:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d3adb81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6548:x1875521225886080:12345-0@lo:502: 00000100:00100000:1.0:1788636510.979382:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d3adb81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6548:x1875521225886080:12345-0@lo:502: Request processed in 112us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636510.979389:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788636510.979467:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6548:1875521225886080:0@lo:502: 00000020:01000004:3.0:1788636510.979535:0:6548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788636510.979555:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000993eea92) 00000020:00000080:3.0:1788636510.979578:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788636510.979684:0:6548:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ff1be3ad from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788636510.979688:0:6548:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ff1be3ad from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788636510.979697:0:6548:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ff1be3ad 4 00010000:00080000:3.0:1788636510.979739:0:6548:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ccc59352@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.126@tcp at head 00010000:00010000:3.0:1788636510.981457:0:6548:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788636510.981679:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788636510.981730:0:6548:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788636510.981748:0:6548:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5b741ef42e837dee 00000100:00080000:3.0:1788636510.981776:0:6548:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636510.981782:0:6548:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ccc59352 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636510.981851:0:6548:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000057625ad x1875521225886208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636510.981883:0:6548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788636510.984493:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875521225886208:0@lo:38: 00000100:00100000:0.0:1788636510.984614:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636510.984761:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225886208 00000100:00100000:2.0:1788636510.984771:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225886208 00000100:00100000:2.0:1788636510.984900:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636510.984907:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b603f7ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521225886208:12345-0@lo:38: 00000100:00100000:2.0:1788636510.984990:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b603f7ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521225886208:12345-0@lo:38: Request processed in 81us (376us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788636510.984998:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636510.986035:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788636510.986051:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000ccc59352 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788636510.986060:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788636510.986065:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875521225886208:0@lo:38: 00000100:00100000:3.0:1788636510.991540:0:6548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6548:1875521225886336:0@lo:502: 00000100:00100000:3.0:1788636510.991656:0:6548:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.991709:0:6548:0:(client.c:2716:ptlrpc_set_wait()) set 00000000760d9dcb going to sleep for 11 seconds 00000100:00100000:3.0:1788636510.992089:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225886336 00000100:00100000:3.0:1788636510.992099:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225886336 00000100:00100000:3.0:1788636510.992161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788636510.992171:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c552519 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6548:x1875521225886336:12345-0@lo:502: 00000100:00100000:3.0:1788636510.992332:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c552519 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6548:x1875521225886336:12345-0@lo:502: Request processed in 162us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636510.992340:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788636510.992430:0:6548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000057625ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6548:1875521225886336:0@lo:502: 00000040:00080000:2.0:1788636510.992462:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788636510.992717:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788636510.992741:0:6498:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788636510.992778:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636510.992790:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788636510.993148:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788636510.993152:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788636510.993153:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636510.993154:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636510.993155:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636510.993158:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636510.993159:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788636510.993160:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788636510.993161:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788636510.993163:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788636510.993165:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636510.993166:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788636510.993172:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788636510.993175:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788636510.993177:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788636510.993178:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636510.993179:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636510.993180:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636510.993181:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636510.993182:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788636510.993183:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788636510.993184:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788636510.993185:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788636510.993186:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636510.993187:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788636510.993209:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788636510.993222:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008795e872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225886464:0@lo:253: 00000100:00100000:3.0:1788636510.993269:0:6498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636510.993304:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a3a3c59 going to sleep for 11 seconds 00000100:00100000:1.0:1788636510.993361:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225886464 00000100:00100000:1.0:1788636510.993368:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225886464 00000100:00100000:1.0:1788636510.993413:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788636510.993421:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e18ad44f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6498:x1875521225886464:12345-0@lo:253: 20000000:01000000:1.0:1788636510.993447:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788636510.993462:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788636511.000042:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788636511.000065:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788636511.000368:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e18ad44f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6498:x1875521225886464:12345-0@lo:253: Request processed in 6944us (7095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636511.000383:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:3.0:1788636511.000539:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788636511.000546:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788636511.000590:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.000612:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837dbd expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.000620:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.000676:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837dbd expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.000695:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837dc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837dbd expref: 11 pid: 6513 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636511.000709:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055cc24a9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225886592:0@lo:104: 00000100:00100000:3.0:1788636511.000748:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636511.000838:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 00000000760d9dcb going to sleep for 11 seconds 00000100:00100000:2.0:1788636511.001036:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008795e872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6498:1875521225886464:0@lo:253: 10000000:01000000:2.0:1788636511.001053:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788636511.001057:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636511.001059:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788636511.001061:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636511.001062:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636511.001063:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636511.001064:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636511.001066:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636511.001068:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788636511.001069:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636511.001070:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636511.001072:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636511.001073:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788636511.001096:0:6498:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788636511.001993:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225886592 00000100:00100000:1.0:1788636511.002010:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225886592 00000100:00100000:1.0:1788636511.002077:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636511.002088:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2e68da9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6537:x1875521225886592:12345-0@lo:104: 00010000:00010000:1.0:1788636511.002107:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636511.002216:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636511.002222:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2e68da9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6537:x1875521225886592:12345-0@lo:104: Request processed in 137us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636511.002229:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636511.002267:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055cc24a9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225886592:0@lo:104: 00010000:00010000:1.0:1788636511.002283:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.003150:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636511.003159:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.003169:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002c75f389 already unused, calling callback (00000000e0381c25) 10000000:00010000:3.0:1788636511.003173:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.003183:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636511.003190:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636511.003213:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636511.003254:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.003261:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636511.003276:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.003283:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: 000000002c75f389/0x5b741ef42e837dbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837dc4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.003302:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636511.003304:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636511.003305:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636511.003865:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008aea93dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225886720:0@lo:103: 00000100:00100000:1.0:1788636511.003947:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636511.004976:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225886720 00000100:00100000:0.0:1788636511.004994:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225886720 00010000:00010000:0.0:1788636511.005040:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837dc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837dbd expref: 12 pid: 6513 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636511.005084:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636511.005093:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff0b563f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:3647:x1875521225886720:12345-0@lo:103: 00010000:00010000:0.0:1788636511.005110:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636511.005114:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837dc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837dbd expref: 12 pid: 6513 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005127:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837dbd expref: 12 pid: 6513 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005146:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837dc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837dbd expref: 12 pid: 6513 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005182:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005189:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788636511.005208:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004664106s 00010000:00010000:0.0:1788636511.005212:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005218:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005223:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005228:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005233:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000037205808 already unused, calling callback (00000000ea3c6fd1) 00010000:00010000:0.0:1788636511.005237:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005243:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005261:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636511.005270:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636511.005342:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff0b563f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:3647:x1875521225886720:12345-0@lo:103: Request processed in 250us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636511.005349:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636511.005400:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008aea93dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225886720:0@lo:103: 00010000:00010000:3.0:1788636511.006926:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.006948:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636511.006955:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000037205808/0x5b741ef42e837df5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788636511.012442:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1788636511.012625:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788636511.013334:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788636511.013576:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788636511.013803:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788636511.015284:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788636511.019064:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788636511.019253:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788636511.019453:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788636511.019621:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788636511.020330:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788636511.020541:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788636511.023597:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788636511.033353:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788636511.033664:0:6554:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788636511.034971:0:6553:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788636511.034978:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788636511.035522:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788636511.035640:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788636511.036362:0:6498:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788636511.036373:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788636511.038251:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636511.039717:0:6554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636511.041943:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788636511.042576:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788636511.042628:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788636511.043009:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788636511.043436:0:6498:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788636511.044218:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788636511.044371:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788636511.044509:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788636511.044645:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788636511.045161:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788636511.045455:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788636511.045614:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788636511.045775:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788636511.045956:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788636511.046099:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788636511.046251:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788636511.046405:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788636511.046545:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788636511.046730:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788636511.046928:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788636511.047051:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788636511.047352:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788636511.047531:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788636511.047663:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788636511.047802:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788636511.047984:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788636511.048129:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788636511.048254:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788636511.048392:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788636511.048530:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788636511.048707:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788636511.051288:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788636511.051544:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788636511.051684:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000040:00080000:3.0:1788636511.052434:0:6554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788636511.052522:0:6554:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788636511.052527:0:6554:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1788636511.052772:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788636511.053388:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788636511.053564:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788636511.054222:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1788636511.058022:0:6498:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788636511.058087:0:6498:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb25401c3b988 00100000:10000000:3.0:1788636511.058098:0:6498:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788636511.058767:0:6498:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788636511.058787:0:6498:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788636511.058984:0:6498:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788636511.059014:0:6498:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788636511.065150:0:6498:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636511.065416:0:6498:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788636511.509128:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636512.534036:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636513.560008:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636514.581336:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636515.605738:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788636515.717184:0:6798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788636515.994957:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002642983 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225886848:0@lo:400: 00000100:00100000:0.0:1788636515.995030:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636515.995119:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225886848 00000100:00100000:2.0:1788636515.995130:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225886848 00000100:00100000:2.0:1788636515.995173:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788636515.995181:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f41759d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:3648:x1875521225886848:12345-0@lo:400: 00000100:00080000:1.0:1788636515.995337:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788636515.995342:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788636515.995345:0:8:0:(import.c:65:import_set_state_nolock()) 00000000ccc59352 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636515.995353:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ccc59352 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636515.995374:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000056cc61cd x1875521225886976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636515.995407:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056cc61cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875521225886976:0@lo:38: 00000100:00100000:1.0:1788636515.995444:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636515.995606:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f41759d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:3648:x1875521225886848:12345-0@lo:400: Request processed in 424us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636515.995614:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788636515.995674:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002642983 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225886848:0@lo:400: 00000100:00100000:0.0:1788636515.995706:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225886976 00000100:00100000:0.0:1788636515.995709:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225886976 00000100:00100000:0.0:1788636515.995744:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636515.995749:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004db8b207 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875521225886976:12345-0@lo:38: 00010000:00080000:0.0:1788636515.995770:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:0.0:1788636515.996019:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5b741ef42e837dfc 00000004:00100000:0.0:1788636515.996073:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788636515.996294:0:6523:0:(import.c:65:import_set_state_nolock()) 000000003f4af0bc : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636515.996387:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004db8b207 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875521225886976:12345-0@lo:38: Request processed in 636us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636515.996394:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788636515.996438:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000056cc61cd x1875521225886976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788636515.996452:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788636515.996473:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788636515.996478:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788636515.996481:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000ccc59352 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788636515.996486:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056cc61cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875521225886976:0@lo:38: 00000020:00000004:3.0:1788636516.615788:0:6851:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636516.616230:0:6851:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788636516.629880:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636517.658127:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636518.677572:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788636519.062781:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788636519.062789:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf00324c000 from 3 10000000:01000000:2.0:1788636519.062794:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788636519.062865:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636519.062891:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636519.062902:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636519.062930:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000050651432 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225887104:0@lo:101: 00000100:00100000:2.0:1788636519.063006:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636519.063056:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8f01db2 going to sleep for 11 seconds 00000100:00100000:1.0:1788636519.063155:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225887104 00000100:00100000:1.0:1788636519.063164:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225887104 00000100:00100000:1.0:1788636519.063224:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788636519.063233:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b298e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:6519:x1875521225887104:12345-0@lo:101: 00010000:00010000:1.0:1788636519.063248:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636519.063266:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2b427de/0x5b741ef42e837e0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837e03 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636519.063292:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2b427de/0x5b741ef42e837e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837e03 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636519.063304:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2b427de/0x5b741ef42e837e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837e03 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636519.063313:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2b427de, rc 0) 00000100:00100000:1.0:1788636519.063356:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b298e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6519:x1875521225887104:12345-0@lo:101: Request processed in 124us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636519.063362:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788636519.063408:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000050651432 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225887104:0@lo:101: 00010000:00010000:1.0:1788636519.063423:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636519.063442:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636519.063489:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056cc61cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225887232:0@lo:256: 00000100:00100000:1.0:1788636519.063516:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636519.063529:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b32d919 going to sleep for 11 seconds 00000100:00100000:1.0:1788636519.063541:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225887232 00000100:00100000:1.0:1788636519.063545:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225887232 00000100:00100000:1.0:1788636519.063562:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788636519.063567:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043ef0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6519:x1875521225887232:12345-0@lo:256: 20000000:01000000:1.0:1788636519.063580:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788636519.063598:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788636519.063601:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788636519.063665:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043ef0877 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:6519:x1875521225887232:12345-0@lo:256: Request processed in 97us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636519.063671:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788636519.063707:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056cc61cd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225887232:0@lo:256: 10000000:01000000:1.0:1788636519.063740:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788636519.063745:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636519.063753:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1788636519.594729:0:6952:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788636519.595268:0:6952:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788636519.701222:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636520.732885:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636521.122431:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc1a1cf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225887360:0@lo:400: 00000100:00100000:3.0:1788636521.122702:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636521.122901:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004bd6b537 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225887488:0@lo:400: 00000100:00100000:0.0:1788636521.122938:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636521.130223:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225887360 00000100:00100000:2.0:1788636521.130237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225887360 00000100:00100000:2.0:1788636521.130305:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788636521.130314:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcbb5b3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:3649:x1875521225887360:12345-0@lo:400: 00000100:00100000:1.0:1788636521.137178:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225887488 00000100:00100000:1.0:1788636521.137192:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225887488 00000100:00100000:1.0:1788636521.137242:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636521.137270:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013b75387 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225887488:12345-0@lo:400: 00000100:00100000:1.0:1788636521.137362:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013b75387 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225887488:12345-0@lo:400: Request processed in 95us (14424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636521.137369:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788636521.140918:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004bd6b537 x1875521225887488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636521.140942:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004bd6b537 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225887488:0@lo:400: 00000100:00100000:2.0:1788636521.142375:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcbb5b3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:3649:x1875521225887360:12345-0@lo:400: Request processed in 12056us (19668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636521.142390:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788636521.144359:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc1a1cf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225887360:0@lo:400: 00010000:00010000:3.0:1788636521.749023:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636522.773973:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636523.797092:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636524.821989:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636525.848124:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636526.230047:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636526.230072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000014327a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225887616:0@lo:400: 00000100:00100000:2.0:1788636526.230175:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636526.230227:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636526.230235:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000037600576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225887744:0@lo:400: 00000100:00100000:2.0:1788636526.230268:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636526.230312:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225887616 00000100:00100000:2.0:1788636526.230320:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225887616 00000100:00100000:2.0:1788636526.230367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636526.230375:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000411f6869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:3646:x1875521225887616:12345-0@lo:400: 00000100:00100000:2.0:1788636526.230420:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000411f6869 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:3646:x1875521225887616:12345-0@lo:400: Request processed in 45us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636526.230426:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636526.230470:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000014327a0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225887616:0@lo:400: 00000100:00100000:0.0:1788636526.230554:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225887744 00000100:00100000:0.0:1788636526.230559:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225887744 00000100:00100000:0.0:1788636526.230598:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636526.230604:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b387496 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225887744:12345-0@lo:400: 00000100:00100000:0.0:1788636526.230643:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b387496 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225887744:12345-0@lo:400: Request processed in 39us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636526.230673:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788636526.230705:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000037600576 x1875521225887744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636526.230717:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000037600576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225887744:0@lo:400: 00010000:00010000:3.0:1788636526.870336:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636527.894903:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636528.920431:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636529.941446:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788636530.600789:0:7451:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788636530.600794:0:7451:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788636530.600795:0:7451:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788636530.602007:0:7451:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009ad230c5 00000020:01000004:1.0:1788636530.602030:0:7451:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1788636530.602041:0:7451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788636530.602055:0:7451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000086c6f8f4) 00000020:00000080:1.0:1788636530.602084:0:7451:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788636530.673228:0:7451:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788636530.673315:0:7451:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788636530.721235:0:7451:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788636530.721475:0:7451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788636530.721487:0:7451:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788636530.721499:0:7451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e837e18 00000020:01000004:2.0:1788636530.721506:0:7451:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788636530.721526:0:7451:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788636530.721529:0:7451:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788636530.721534:0:7451:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788636530.721560:0:7451:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788636530.721564:0:7451:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788636530.758435:0:7451:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788636530.758480:0:7451:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.126@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788636530.758485:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788636530.758486:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788636530.758488:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636530.758489:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636530.758490:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636530.758491:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636530.758492:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636530.758494:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636530.758495:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636530.758496:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636530.758497:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788636530.758500:0:7451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788636530.758509:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788636530.758510:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788636530.758510:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636530.758511:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636530.758512:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636530.758513:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636530.758513:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636530.758514:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636530.758515:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636530.758515:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636530.758516:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788636530.758550:0:7451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788636530.758572:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000014327a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225887872:0@lo:253: 00000100:00100000:2.0:1788636530.758672:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636530.758736:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 0000000033ac44f4 going to sleep for 11 seconds 00000100:00100000:3.0:1788636530.758785:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225887872 00000100:00100000:3.0:1788636530.758795:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225887872 00000100:00100000:3.0:1788636530.758873:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636530.758882:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a52b1ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225887872:12345-0@lo:253: 20000000:01000000:3.0:1788636530.758913:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788636530.758919:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788636530.758924:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788636530.758928:0:6513:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788636530.758971:0:6513:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788636530.759316:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636530.759460:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788636530.759476:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788636530.759494:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788636530.759510:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788636530.759523:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788636530.759581:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788636530.759601:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788636530.759623:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788636530.759630:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788636530.759642:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788636530.759646:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788636530.759656:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788636530.759668:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788636530.759878:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788636530.759889:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788636530.759903:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788636530.759909:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788636530.759921:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788636530.759926:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.126@tcp (null) (null) 00000040:00080000:3.0:1788636530.759938:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788636530.759943:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788636530.759954:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788636530.759968:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788636530.759980:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788636530.760054:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788636530.760063:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788636530.760250:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788636530.760272:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788636530.760286:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788636530.760291:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788636530.760302:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788636530.760322:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788636530.760327:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788636530.760350:0:6513:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788636530.760357:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788636530.764363:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788636530.765386:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788636530.765421:0:6513:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.126@tcp for mdt 20000000:01000000:2.0:1788636530.765423:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788636530.765439:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788636530.765444:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788636530.765456:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788636530.765461:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.126@tcp (null) (null) 00000040:00080000:2.0:1788636530.765475:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788636530.765483:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788636530.765494:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788636530.765508:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788636530.765559:0:6513:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788636530.765568:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1788636530.766981:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788636530.767332:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788636530.767368:0:6513:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.126@tcp for mdt 20000000:01000000:3.0:1788636530.767371:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.126@tcp (null) (null) (null) 00000040:00080000:3.0:1788636530.767387:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788636530.767392:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788636530.767407:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788636530.767413:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.126@tcp (null) (null) 00000040:00080000:3.0:1788636530.767425:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788636530.767433:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788636530.767444:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788636530.767457:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788636530.767482:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788636530.767485:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788636530.767490:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788636530.767543:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788636530.767546:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788636530.769224:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788636530.769283:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788636530.769301:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788636530.770169:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788636530.770199:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788636530.770216:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788636530.770231:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788636530.770234:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788636530.770574:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788636530.770603:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788636530.770628:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788636530.770985:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788636530.771009:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788636530.771025:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788636530.771034:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788636530.771036:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788636530.772240:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788636530.772276:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788636530.772290:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788636530.778189:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788636530.778229:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788636530.778255:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788636530.778276:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788636530.778279:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788636530.778285:0:6513:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788636530.778291:0:6513:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788636530.780884:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788636530.781241:0:6513:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788636530.792189:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788636530.792219:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.792240:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000417ae2f5/0x5b741ef42e837d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837d4d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.792264:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000073865ccf/0x5b741ef42e837d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837d69 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.792269:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009221780e/0x5b741ef42e837de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837dd9 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.792276:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.792315:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009221780e/0x5b741ef42e837de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837dd9 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.792328:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009221780e/0x5b741ef42e837de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837dd9 expref: 12 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.792342:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056cc61cd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225888000:0@lo:104: 00000100:00100000:1.0:1788636530.792419:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636530.792524:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000073865ccf/0x5b741ef42e837d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837d69 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.792532:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000073865ccf/0x5b741ef42e837d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837d69 expref: 12 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.792540:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000371b35ec pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225888128:0@lo:104: 00000100:00100000:1.0:1788636530.792561:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636530.793323:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000417ae2f5/0x5b741ef42e837d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837d4d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.793335:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000417ae2f5/0x5b741ef42e837d54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837d4d expref: 12 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636530.793344:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af30a428 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225888256:0@lo:104: 00000100:00100000:0.0:1788636530.793375:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636530.793458:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225888000 00000100:00100000:3.0:1788636530.793469:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225888000 00000100:00100000:3.0:1788636530.793515:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225888128 00000100:00100000:3.0:1788636530.793518:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225888128 00000100:00100000:3.0:1788636530.793532:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636530.793540:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000258c1554 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6513:x1875521225888000:12345-0@lo:104: 00010000:00010000:3.0:1788636530.793552:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636530.793643:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636530.793648:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000258c1554 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6513:x1875521225888000:12345-0@lo:104: Request processed in 109us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636530.793655:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636530.793673:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636530.793679:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087edd3a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6513:x1875521225888128:12345-0@lo:104: 00010000:00010000:1.0:1788636530.793836:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636530.793843:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.793861:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f5c88c0f already unused, calling callback (00000000e0381c25) 10000000:00010000:1.0:1788636530.793865:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.793873:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636530.793879:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636530.793884:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636530.793917:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.793924:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636530.793944:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.793950:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: 00000000f5c88c0f/0x5b741ef42e837dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837de0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.793966:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636530.793969:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636530.793970:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636530.793991:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be3ef9e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225888384:0@lo:103: 00000100:00100000:1.0:1788636530.794022:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.794074:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225888384 00000100:00100000:1.0:1788636530.794078:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225888384 00010000:00010000:1.0:1788636530.794115:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009221780e/0x5b741ef42e837de0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837dd9 expref: 13 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.794141:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636530.794147:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000562b64be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:3649:x1875521225888384:12345-0@lo:103: 00010000:00010000:1.0:1788636530.794156:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636530.794160:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009221780e/0x5b741ef42e837de0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837dd9 expref: 13 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.794169:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009221780e/0x5b741ef42e837de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837dd9 expref: 13 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.794184:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636530.794210:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000562b64be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:3649:x1875521225888384:12345-0@lo:103: Request processed in 64us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636530.794216:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636530.794261:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be3ef9e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225888384:0@lo:103: 00000100:00100000:0.0:1788636530.794368:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f1edec1 going to sleep for 11 seconds 00010000:00010000:0.0:1788636530.794382:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009221780e/0x5b741ef42e837de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837dd9 expref: 12 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636530.794391:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056cc61cd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225888000:0@lo:104: 00010000:00010000:3.0:1788636530.794443:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636530.794498:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636530.794503:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087edd3a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6513:x1875521225888128:12345-0@lo:104: Request processed in 826us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636530.794510:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636530.794525:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225888256 00000100:00100000:3.0:1788636530.794529:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225888256 00000100:00100000:3.0:1788636530.794545:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636530.794551:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a59d7cca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6513:x1875521225888256:12345-0@lo:104: 00010000:00010000:3.0:1788636530.794559:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636530.794604:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788636530.794608:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a59d7cca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6513:x1875521225888256:12345-0@lo:104: Request processed in 59us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636530.794615:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636530.794668:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000371b35ec pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225888128:0@lo:104: 00000100:00100000:0.0:1788636530.794676:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af30a428 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225888256:0@lo:104: 00010000:00010000:0.0:1788636530.794707:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.794840:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636530.794846:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.794852:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005907e2b2 already unused, calling callback (00000000e0381c25) 10000000:00010000:1.0:1788636530.794855:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.794861:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636530.794867:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636530.794887:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636530.794914:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.794921:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636530.794945:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.794952:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: 000000005907e2b2/0x5b741ef42e837d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837d70 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.794962:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636530.794964:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.794969:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee3e54fa already unused, calling callback (00000000e0381c25) 10000000:00010000:1.0:1788636530.794970:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.794976:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636530.794981:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636530.794986:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636530.794996:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795001:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636530.795012:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795016:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837d54 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795030:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636530.795032:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636530.795033:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636530.795044:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225888640:0@lo:103: 00000100:00100000:1.0:1788636530.795076:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.795100:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636530.795105:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be3ef9e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225888512:0@lo:103: 00000100:00100000:1.0:1788636530.795123:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.795145:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225888640 00000100:00100000:1.0:1788636530.795149:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225888640 00010000:00010000:1.0:1788636530.795164:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000417ae2f5/0x5b741ef42e837d54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837d4d expref: 12 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.795179:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225888512 00000100:00100000:1.0:1788636530.795181:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225888512 00010000:00010000:1.0:1788636530.795189:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000073865ccf/0x5b741ef42e837d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837d69 expref: 13 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.795200:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788636530.795204:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a23a11a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:3647:x1875521225888640:12345-0@lo:103: 00010000:00010000:1.0:1788636530.795214:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636530.795217:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000417ae2f5/0x5b741ef42e837d54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837d4d expref: 13 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795237:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000417ae2f5/0x5b741ef42e837d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837d4d expref: 13 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795246:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000417ae2f5/0x5b741ef42e837d54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837d4d expref: 13 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795256:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636530.795283:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a23a11a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:3647:x1875521225888640:12345-0@lo:103: Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636530.795289:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788636530.795303:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636530.795309:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000304de4fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:3647:x1875521225888512:12345-0@lo:103: 00010000:00010000:1.0:1788636530.795316:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636530.795320:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000073865ccf/0x5b741ef42e837d70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837d69 expref: 11 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795327:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000073865ccf/0x5b741ef42e837d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837d69 expref: 11 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795336:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000073865ccf/0x5b741ef42e837d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837d69 expref: 11 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795345:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795352:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795363:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795375:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795381:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795387:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795391:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000022bef06a already unused, calling callback (00000000ea3c6fd1) 00010000:00010000:1.0:1788636530.795394:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795400:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795410:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.795419:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636530.795438:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000304de4fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:3647:x1875521225888512:12345-0@lo:103: Request processed in 131us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636530.795445:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636530.795471:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be3ef9e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225888512:0@lo:103: 00000100:00100000:1.0:1788636530.795479:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225888640:0@lo:103: 00010000:00010000:1.0:1788636530.795496:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636530.795630:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.795638:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.795653:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000022bef06a/0x5b741ef42e837e1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788636530.795673:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788636530.798192:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a52b1ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:7451:x1875521225887872:12345-0@lo:253: Request processed in 39300us (39510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636530.798208:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788636530.798353:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000014327a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225887872:0@lo:253: 10000000:01000000:2.0:1788636530.798371:0:7451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788636530.798374:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636530.798377:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788636530.798378:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636530.798380:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788636530.798382:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636530.798383:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636530.798384:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636530.798385:0:7451:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788636530.798387:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636530.798388:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788636530.798412:0:7451:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009ad230c5 from lustre-MDT0001 10000000:01000000:2.0:1788636530.798445:0:7451:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788636530.798449:0:7451:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788636530.798457:0:7451:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf040b3b380 local copy 10000000:01000000:2.0:1788636530.798462:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788636530.798507:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.798518:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.798527:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636530.798545:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000014327a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225888768:0@lo:101: 00000100:00100000:2.0:1788636530.798609:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636530.798650:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000009582f09c going to sleep for 11 seconds 00000100:00100000:0.0:1788636530.798847:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225888768 00000100:00100000:0.0:1788636530.798855:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225888768 00000100:00100000:0.0:1788636530.798899:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788636530.798908:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbf69d78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:7451:x1875521225888768:12345-0@lo:101: 00010000:00010000:0.0:1788636530.798925:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636530.798942:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d56bea63/0x5b741ef42e837e2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837e26 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.798968:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d56bea63/0x5b741ef42e837e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837e26 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.798978:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d56bea63/0x5b741ef42e837e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837e26 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.798988:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d56bea63, rc 0) 00000100:00100000:0.0:1788636530.799026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbf69d78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:7451:x1875521225888768:12345-0@lo:101: Request processed in 120us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636530.799032:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788636530.799132:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000014327a0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225888768:0@lo:101: 00010000:00010000:1.0:1788636530.799145:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.799160:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.799252:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225888896:0@lo:501: 00000100:00100000:1.0:1788636530.799278:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.799308:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b99317f going to sleep for 11 seconds 00000100:00100000:2.0:1788636530.799368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225888896 00000100:00100000:2.0:1788636530.799373:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225888896 00000100:00100000:2.0:1788636530.799405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788636530.799411:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a131e579 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:7451:x1875521225888896:12345-0@lo:501: 00000100:00100000:2.0:1788636530.799471:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a131e579 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:7451:x1875521225888896:12345-0@lo:501: Request processed in 60us (192us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788636530.799478:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788636530.799551:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225888896:0@lo:501: 10000000:01000000:1.0:1788636530.799567:0:7451:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788636530.799595:0:7451:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788636530.799600:0:7451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.799608:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.799614:0:7451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.799640:0:7451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788636530.799671:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf00f150000 10000000:01000000:1.0:1788636530.799676:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788636530.799681:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cf040b3b380 10000000:01000000:1.0:1788636530.799684:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788636530.799699:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cf040b3b380 from 1 10000000:01000000:1.0:1788636530.799702:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788636530.799718:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 00000000173cdf91/0x5b741ef42e837e34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.799737:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 00000000173cdf91/0x5b741ef42e837e34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.799745:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 00000000173cdf91/0x5b741ef42e837e34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.799757:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889024:0@lo:101: 00000100:00100000:1.0:1788636530.799782:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.799794:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000007bd51c15 going to sleep for 11 seconds 00000100:00100000:0.0:1788636530.799956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225889024 00000100:00100000:0.0:1788636530.799961:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225889024 00000100:00100000:0.0:1788636530.799993:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788636530.800010:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000471d8cb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:7451:x1875521225889024:12345-0@lo:101: 00010000:00010000:0.0:1788636530.800018:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636530.800031:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000197a2125/0x5b741ef42e837e3b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837e34 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.800048:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000197a2125/0x5b741ef42e837e3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837e34 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.800058:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000197a2125/0x5b741ef42e837e3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837e34 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.800067:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000197a2125, rc 0) 00000100:00100000:0.0:1788636530.800095:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000471d8cb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:7451:x1875521225889024:12345-0@lo:101: Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636530.800100:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788636530.800164:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636530.800170:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.800176:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003abbf3c5 already unused, calling callback (00000000e0381c25) 10000000:00010000:2.0:1788636530.800180:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.800187:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636530.800194:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636530.800200:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636530.800221:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.800227:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636530.800256:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.800271:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837e26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b741ef42e837e2d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.800286:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636530.800288:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636530.800289:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636530.800297:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636530.800310:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000163d60bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225889152:0@lo:103: 00000100:00100000:2.0:1788636530.800341:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636530.800379:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225889152 00000100:00100000:2.0:1788636530.800383:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225889152 00000100:00100000:2.0:1788636530.800413:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636530.800418:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e562e27c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:3649:x1875521225889152:12345-0@lo:103: 00010000:00010000:2.0:1788636530.800426:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636530.800437:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d56bea63/0x5b741ef42e837e2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b741ef42e837e26 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.800449:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636530.800474:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e562e27c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:3649:x1875521225889152:12345-0@lo:103: Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636530.800481:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636530.800508:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000163d60bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225889152:0@lo:103: 00000100:00100000:1.0:1788636530.800608:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889024:0@lo:101: 00010000:00010000:1.0:1788636530.800620:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 00000000173cdf91/0x5b741ef42e837e34 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e3b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.800628:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 00000000173cdf91/0x5b741ef42e837e34 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837e3b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636530.800645:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788636530.800664:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 00000000173cdf91/0x5b741ef42e837e34 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e3b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.800671:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 00000000173cdf91/0x5b741ef42e837e34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e3b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636530.800680:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cf00f150000 10000000:01000000:1.0:1788636530.800684:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788636530.800695:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cf00f150000 from 1 10000000:01000000:1.0:1788636530.800697:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788636530.800710:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 00000000d7067129/0x5b741ef42e837e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.800722:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 00000000d7067129/0x5b741ef42e837e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.800729:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 00000000d7067129/0x5b741ef42e837e42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.800742:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889280:0@lo:101: 00000100:00100000:1.0:1788636530.800767:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.800789:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000007bd51c15 going to sleep for 11 seconds 00000100:00100000:0.0:1788636530.800875:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225889280 00000100:00100000:0.0:1788636530.800879:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225889280 00000100:00100000:0.0:1788636530.800913:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788636530.800919:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8ced488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+10:7451:x1875521225889280:12345-0@lo:101: 00010000:00010000:0.0:1788636530.800927:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636530.800936:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007a83359b/0x5b741ef42e837e49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837e42 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.800949:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007a83359b/0x5b741ef42e837e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837e42 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.800956:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007a83359b/0x5b741ef42e837e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837e42 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.800962:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007a83359b, rc 0) 00000100:00100000:0.0:1788636530.800991:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8ced488 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:7451:x1875521225889280:12345-0@lo:101: Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636530.800997:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788636530.801170:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889280:0@lo:101: 00010000:00010000:1.0:1788636530.801180:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 00000000d7067129/0x5b741ef42e837e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.801186:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 00000000d7067129/0x5b741ef42e837e42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636530.801196:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788636530.801210:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 00000000d7067129/0x5b741ef42e837e42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.801217:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 00000000d7067129/0x5b741ef42e837e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636530.801223:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788636530.801227:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636530.801232:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cf00f150000 10000000:01000000:1.0:1788636530.801235:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788636530.801238:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788636530.801246:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788636530.801261:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 00000000bd70324b/0x5b741ef42e837e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.801266:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 00000000bd70324b/0x5b741ef42e837e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.801272:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 00000000bd70324b/0x5b741ef42e837e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.801282:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889408:0@lo:101: 00000100:00100000:1.0:1788636530.801303:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.801328:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000007bd51c15 going to sleep for 11 seconds 00000100:00100000:0.0:1788636530.801368:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225889408 00000100:00100000:0.0:1788636530.801372:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225889408 00000100:00100000:0.0:1788636530.801404:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788636530.801410:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb55f1a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+11:7451:x1875521225889408:12345-0@lo:101: 00010000:00010000:0.0:1788636530.801417:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636530.801425:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e8771460/0x5b741ef42e837e57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837e50 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.801436:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8771460/0x5b741ef42e837e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837e50 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.801443:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e8771460/0x5b741ef42e837e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837e50 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.801448:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e8771460, rc 0) 00000100:00100000:0.0:1788636530.801468:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb55f1a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225889408:12345-0@lo:101: Request processed in 60us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636530.801473:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788636530.801549:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889408:0@lo:101: 00010000:00010000:1.0:1788636530.801558:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 00000000bd70324b/0x5b741ef42e837e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.801564:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 00000000bd70324b/0x5b741ef42e837e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.801647:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889536:0@lo:501: 00000100:00100000:1.0:1788636530.801668:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636530.801754:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225889536 00000100:00100000:2.0:1788636530.801759:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225889536 00000100:00100000:2.0:1788636530.801787:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788636530.801793:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000258a0ccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225889536:12345-0@lo:501: 00000100:00100000:2.0:1788636530.803303:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000258a0ccc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225889536:12345-0@lo:501: Request processed in 1504us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636530.803316:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788636530.803409:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000007bd51c15 going to sleep for 11 seconds 00000100:00100000:1.0:1788636530.803429:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889536:0@lo:501: 00000100:00100000:1.0:1788636530.803474:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889664:0@lo:503: 00000100:00100000:1.0:1788636530.803522:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.803710:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000007bd51c15 going to sleep for 11 seconds 00000100:00100000:0.0:1788636530.803796:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225889664 00000100:00100000:0.0:1788636530.803802:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225889664 00000100:00100000:0.0:1788636530.804032:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788636530.804039:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc6906ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225889664:12345-0@lo:503: 00000100:00100000:0.0:1788636530.804145:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc6906ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225889664:12345-0@lo:503: Request processed in 106us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636530.804152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788636530.804213:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889664:0@lo:503: 00000040:00080000:1.0:1788636530.804465:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788636530.804538:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889792:0@lo:502: 00000100:00100000:1.0:1788636530.804569:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.804678:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000007bd51c15 going to sleep for 11 seconds 00000100:00100000:2.0:1788636530.804892:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225889792 00000100:00100000:2.0:1788636530.804897:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225889792 00000100:00100000:2.0:1788636530.804924:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788636530.804929:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a19dfdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225889792:12345-0@lo:502: 00000100:00100000:2.0:1788636530.805018:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a19dfdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225889792:12345-0@lo:502: Request processed in 88us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636530.805024:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788636530.805116:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889792:0@lo:502: 00000040:00080000:1.0:1788636530.805337:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788636530.805365:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788636530.805379:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788636530.805393:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788636530.805406:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788636530.805420:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788636530.805436:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788636530.805449:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788636530.805462:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788636530.805475:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788636530.805487:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788636530.805500:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788636530.805512:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788636530.805525:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788636530.805537:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788636530.805550:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788636530.805562:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788636530.805576:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788636530.805606:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788636530.805860:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788636530.805876:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788636530.805890:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788636530.805903:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788636530.805931:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889920:0@lo:502: 00000100:00100000:1.0:1788636530.805985:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.806026:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000007bd51c15 going to sleep for 11 seconds 00000100:00100000:2.0:1788636530.806117:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225889920 00000100:00100000:2.0:1788636530.806123:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225889920 00000100:00100000:2.0:1788636530.806149:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636530.806155:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1884053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225889920:12345-0@lo:502: 00000100:00100000:2.0:1788636530.806245:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1884053 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225889920:12345-0@lo:502: Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636530.806251:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788636530.806348:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225889920:0@lo:502: 00000040:00080000:1.0:1788636530.806391:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788636530.806398:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788636530.807399:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636530.807417:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.807420:0:7463:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788636530.807438:0:7463:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788636530.807441:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788636530.807458:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000001866f734) 00000020:00000080:3.0:1788636530.807487:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788636530.807494:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788636530.807834:0:7463:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788636530.807853:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e837e65 00000020:00000080:3.0:1788636530.808081:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788636530.808086:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636530.808089:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.808091:0:7463:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788636530.808094:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636530.808097:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.808098:0:7463:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788636530.808100:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788636530.808115:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000002de2d92f) 00000020:00000080:3.0:1788636530.808128:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788636530.808132:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788636530.808134:0:7463:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788636530.808137:0:7463:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788636530.808143:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788636530.808190:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009ad230c5 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788636530.808202:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000051e59bee) 00000020:00000080:3.0:1788636530.808212:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788636530.808281:0:7463:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788636530.808289:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e837e7a 00000020:00000080:3.0:1788636530.808396:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788636530.808403:0:7463:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788636530.808406:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5b741ef42e837e81 00080000:01000000:3.0:1788636530.808411:0:7463:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788636530.808415:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e837e88 00080000:10000000:3.0:1788636530.809325:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788636530.809453:0:7463:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1788636530.940710:0:7463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788636530.941255:0:7463:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788636530.944056:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788636530.944464:0:7463:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788636530.955545:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788636530.955560:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636530.955566:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.955568:0:7463:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788636530.955572:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636530.955578:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.955591:0:7463:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788636530.955595:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788636530.955599:0:7463:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:00000080:3.0:1788636530.955637:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788636530.955651:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000244c94de) 00000020:00000080:3.0:1788636530.955675:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788636530.955680:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788636530.955765:0:7463:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788636530.955771:0:7463:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788636530.955777:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e837e96 00010000:00080000:3.0:1788636530.955829:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000687eb733@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.126@tcp at head 00010000:00010000:3.0:1788636530.957891:0:7463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788636530.961665:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788636530.961680:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788636530.961802:0:7463:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788636530.962244:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e837e9d 00000100:00080000:3.0:1788636530.962257:0:7463:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636530.962263:0:7463:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000687eb733 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636530.962301:0:7463:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000033490efc x1875521225890048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788636530.962381:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033490efc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521225890048:0@lo:38: 00000100:00080000:3.0:1788636530.963779:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788636530.963999:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636530.964006:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.964009:0:7463:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788636530.964012:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788636530.964015:0:7463:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788636530.964017:0:7463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788636530.964018:0:7463:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788636530.964019:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788636530.964022:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.964023:0:7463:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788636530.964025:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636530.964030:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.964031:0:7463:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788636530.964035:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788636530.964087:0:7463:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788636530.964100:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636530.964103:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.964104:0:7463:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788636530.964106:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636530.964109:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.964110:0:7463:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788636530.964113:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788636530.964114:0:7463:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788636530.964138:0:7463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1788636530.964608:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636530.964869:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225890048 00000100:00100000:3.0:1788636530.964878:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225890048 00000100:00100000:3.0:1788636530.964910:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636530.964917:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000163d60bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875521225890048:12345-0@lo:38: 00010000:00080000:3.0:1788636530.964942:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:3.0:1788636530.964996:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e837ea4 00000004:00100000:3.0:1788636530.965016:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788636530.965022:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:00000080:3.0:1788636530.965083:0:7463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636530.965085:0:7463:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788636530.965090:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:1.0:1788636530.965337:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1788636530.965374:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788636530.965397:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 00000000bd70324b/0x5b741ef42e837e50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.965409:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 00000000bd70324b/0x5b741ef42e837e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636530.965419:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf00f150000 from 1 10000000:01000000:1.0:1788636530.965422:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788636530.965459:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.965467:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.965475:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.965494:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225890176:0@lo:101: 00000100:00100000:1.0:1788636530.965560:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.965589:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8f01db2 going to sleep for 11 seconds 00000100:00100000:1.0:1788636530.965610:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225890176 00000100:00100000:1.0:1788636530.965614:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225890176 00000100:00100000:1.0:1788636530.965648:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788636530.965654:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008f817ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+12:7451:x1875521225890176:12345-0@lo:101: 00010000:00010000:1.0:1788636530.965673:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636530.965696:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005907e2b2/0x5b741ef42e837eb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837eab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.965716:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005907e2b2/0x5b741ef42e837eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837eab expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.965727:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005907e2b2/0x5b741ef42e837eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837eab expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.965735:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005907e2b2, rc 0) 00000100:00100000:1.0:1788636530.965768:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008f817ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:7451:x1875521225890176:12345-0@lo:101: Request processed in 115us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636530.965774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788636530.965840:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225890176:0@lo:101: 00010000:00010000:1.0:1788636530.965853:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.965861:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.966503:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225890304:0@lo:256: 00000100:00100000:1.0:1788636530.966544:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.966560:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8f01db2 going to sleep for 11 seconds 00000100:00100000:3.0:1788636530.967053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225890304 00000100:00100000:3.0:1788636530.967060:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225890304 00000100:00100000:3.0:1788636530.967095:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788636530.967102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021296201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:7451:x1875521225890304:12345-0@lo:256: 20000000:01000000:3.0:1788636530.967121:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788636530.967151:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788636530.967156:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788636530.967246:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021296201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:7451:x1875521225890304:12345-0@lo:256: Request processed in 144us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636530.967254:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788636530.967326:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225890304:0@lo:256: 10000000:01000000:1.0:1788636530.968001:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788636530.968018:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636530.969122:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636530.969246:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af30a428 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225890432:0@lo:400: 00000100:00100000:0.0:1788636530.969320:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636530.969402:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636530.969411:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00f150000 from 1 10000000:01000000:1.0:1788636530.969414:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636530.969440:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.969447:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.969457:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.969471:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225890560:0@lo:101: 00000100:00100000:1.0:1788636530.969506:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.969539:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8f01db2 going to sleep for 11 seconds 00000100:00100000:0.0:1788636530.970836:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225890560 00000100:00100000:0.0:1788636530.970849:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225890560 00000100:00100000:0.0:1788636530.970897:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788636530.970907:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006155b32a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:7451:x1875521225890560:12345-0@lo:101: 00010000:00010000:0.0:1788636530.970924:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636530.970942:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009221780e/0x5b741ef42e837ec0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837eb9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.970969:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009221780e/0x5b741ef42e837ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837eb9 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.970980:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009221780e/0x5b741ef42e837ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837eb9 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.970989:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009221780e, rc 0) 00000100:00100000:0.0:1788636530.971046:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006155b32a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:7451:x1875521225890560:12345-0@lo:101: Request processed in 141us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636530.971054:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788636530.971785:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225890560:0@lo:101: 00010000:00010000:1.0:1788636530.971828:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.971838:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.971942:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225890688:0@lo:501: 00000100:00100000:1.0:1788636530.971981:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.972014:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8f01db2 going to sleep for 11 seconds 00010000:00010000:2.0:1788636530.972254:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636530.972317:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225890688 00000100:00100000:0.0:1788636530.972323:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225890688 00000100:00100000:0.0:1788636530.972366:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788636530.972375:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f60dd0ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:7451:x1875521225890688:12345-0@lo:501: 00000100:00100000:0.0:1788636530.972481:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f60dd0ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:7451:x1875521225890688:12345-0@lo:501: Request processed in 107us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636530.972489:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788636530.972928:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5eea3d pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225890688:0@lo:501: 00000100:00100000:0.0:1788636530.972970:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e192c93a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225890816:0@lo:503: 00000100:00100000:0.0:1788636530.973009:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788636530.973090:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000d33c934b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636530.973138:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000163d60bb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875521225890048:12345-0@lo:38: Request processed in 8221us (8532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636530.973162:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636530.973201:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636530.973209:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788636530.973217:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788636530.973222:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788636530.973224:0:3645:0:(import.c:65:import_set_state_nolock()) 00000000687eb733 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788636530.973234:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033490efc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521225890048:0@lo:38: 00000100:00100000:0.0:1788636530.973347:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b62bd0f going to sleep for 11 seconds 00000100:00100000:3.0:1788636530.973456:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225890432 00000100:00100000:3.0:1788636530.973463:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225890432 00000100:00100000:3.0:1788636530.973494:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636530.973502:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cc3c80b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225890432:12345-0@lo:400: 00000100:00100000:3.0:1788636530.973544:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cc3c80b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225890432:12345-0@lo:400: Request processed in 43us (4224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636530.973550:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788636530.973592:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000af30a428 x1875521225890432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636530.973604:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af30a428 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225890432:0@lo:400: 00000100:00100000:1.0:1788636530.973651:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f56fed4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225890944:0@lo:41: 00000100:00100000:1.0:1788636530.973679:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.973729:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225890944 00000100:00100000:1.0:1788636530.973733:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225890944 00000100:00100000:1.0:1788636530.973757:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636530.973762:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be3ef9e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875521225890944:12345-0@lo:41: 00000004:00000024:1.0:1788636530.973785:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788636530.973843:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be3ef9e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875521225890944:12345-0@lo:41: Request processed in 81us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636530.973849:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636530.973875:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f56fed4e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225890944:0@lo:41: 00000100:00100000:2.0:1788636530.974221:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225890816 00000100:00100000:2.0:1788636530.974226:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225890816 00000100:00100000:2.0:1788636530.974287:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788636530.974295:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000464034e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:7451:x1875521225890816:12345-0@lo:503: 00000040:00080000:2.0:1788636530.974337:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636530.974392:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000464034e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:7451:x1875521225890816:12345-0@lo:503: Request processed in 98us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636530.974407:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788636530.974483:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e192c93a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225890816:0@lo:503: 00000040:00080000:1.0:1788636530.974928:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636530.974975:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788636530.975059:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636530.976505:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788636530.976756:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788636530.976789:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636530.976834:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.976846:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636530.976908:0:7451:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788636530.976911:0:7451:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf00f150000 10000000:01000000:2.0:1788636530.976914:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf00f150000 10000000:01000000:2.0:1788636530.976917:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788636530.976924:0:7451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00f150000 from 1 10000000:01000000:2.0:1788636530.976926:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788636530.976960:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.976968:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.976976:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636530.976999:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032104448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891072:0@lo:101: 00000100:00100000:2.0:1788636530.977061:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636530.977100:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000162795b0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636530.977280:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225891072 00000100:00100000:0.0:1788636530.977288:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225891072 00000100:00100000:0.0:1788636530.977338:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788636530.977347:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007887ffdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:7451:x1875521225891072:12345-0@lo:101: 00010000:00010000:0.0:1788636530.977362:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636530.977375:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d56bea63/0x5b741ef42e837ece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837ec7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.977399:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d56bea63/0x5b741ef42e837ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837ec7 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.977409:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d56bea63/0x5b741ef42e837ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837ec7 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636530.977417:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d56bea63, rc 0) 00000100:00100000:0.0:1788636530.977460:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007887ffdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7451:x1875521225891072:12345-0@lo:101: Request processed in 114us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636530.977468:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788636530.977766:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032104448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891072:0@lo:101: 00010000:00010000:2.0:1788636530.977780:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837ec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.978091:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837ec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636530.978330:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000032104448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891200:0@lo:501: 00000100:00100000:2.0:1788636530.978378:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636530.978413:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000162795b0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636530.978765:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225891200 00000100:00100000:0.0:1788636530.978772:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225891200 00000100:00100000:0.0:1788636530.978876:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788636530.978886:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc29cb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7451:x1875521225891200:12345-0@lo:501: 00000100:00100000:0.0:1788636530.979102:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc29cb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7451:x1875521225891200:12345-0@lo:501: Request processed in 217us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636530.979110:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788636530.979284:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000032104448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891200:0@lo:501: 00000100:00100000:1.0:1788636530.979330:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b26a2d5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891328:0@lo:503: 00000100:00100000:1.0:1788636530.979375:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.979431:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aafad4c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636530.979461:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225891328 00000100:00100000:3.0:1788636530.979466:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225891328 00000100:00100000:3.0:1788636530.979537:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788636530.979543:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000629a0868 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7451:x1875521225891328:12345-0@lo:503: 00000100:00100000:3.0:1788636530.979638:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000629a0868 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7451:x1875521225891328:12345-0@lo:503: Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636530.979645:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788636530.979716:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b26a2d5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891328:0@lo:503: 00000040:00080000:1.0:1788636530.980015:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788636530.980076:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b26a2d5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891456:0@lo:502: 00000100:00100000:1.0:1788636530.980110:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.980468:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aafad4c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636530.980524:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225891456 00000100:00100000:2.0:1788636530.980529:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225891456 00000100:00100000:2.0:1788636530.980554:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788636530.980560:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090ae3246 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7451:x1875521225891456:12345-0@lo:502: 00000100:00100000:2.0:1788636530.980760:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090ae3246 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7451:x1875521225891456:12345-0@lo:502: Request processed in 199us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636530.980767:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788636530.980881:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b26a2d5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891456:0@lo:502: 00000040:00080000:1.0:1788636530.981074:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788636530.981100:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788636530.981114:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788636530.981126:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788636530.981138:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788636530.981230:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788636530.981246:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788636530.981261:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788636530.981276:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788636530.981293:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788636530.981309:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788636530.981322:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788636530.981333:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788636530.981344:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788636530.981360:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788636530.981374:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788636530.981389:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788636530.981402:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788636530.981416:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788636530.981429:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788636530.981452:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788636530.981466:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788636530.981479:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788636530.981493:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788636530.981507:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788636530.981520:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788636530.981532:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788636530.981545:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1788636530.981567:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b26a2d5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891584:0@lo:502: 00000100:00100000:1.0:1788636530.981618:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.981674:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aafad4c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636530.981881:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225891584 00000100:00100000:3.0:1788636530.981889:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225891584 00000100:00100000:2.0:1788636530.981959:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788636530.981967:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c5c577d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7451:x1875521225891584:12345-0@lo:502: 00000100:00100000:2.0:1788636530.982051:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c5c577d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7451:x1875521225891584:12345-0@lo:502: Request processed in 85us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636530.982059:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788636530.982140:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b26a2d5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891584:0@lo:502: 00000040:00080000:1.0:1788636530.982192:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788636530.982199:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788636530.983317:0:7469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788636530.983345:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000004fd3c31d) 00000020:00000080:1.0:1788636530.983369:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788636530.983460:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009ad230c5 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788636530.983465:0:7469:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009ad230c5 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788636530.983467:0:7469:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009ad230c5 3 00010000:00080000:1.0:1788636530.983498:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001760aced@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.126@tcp at head 00010000:00010000:1.0:1788636530.986126:0:7469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788636530.986576:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788636530.986637:0:7469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788636530.986662:0:7469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5b741ef42e837edc 00000100:00080000:1.0:1788636530.986676:0:7469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636530.986692:0:7469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000001760aced using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636530.986726:0:7469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b26a2d5e x1875521225891712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636530.986767:0:7469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788636530.987093:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b26a2d5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521225891712:0@lo:38: 00000100:00100000:2.0:1788636530.987180:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788636530.987604:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788636530.987668:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788636530.987717:0:7451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788636530.987731:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837ec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.987752:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 000000003abbf3c5/0x5b741ef42e837ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788636530.987799:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788636530.987801:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788636530.987803:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636530.987828:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636530.987830:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636530.987831:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636530.987833:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636530.987834:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636530.987836:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636530.987837:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636530.987838:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636530.987842:0:7451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788636530.987844:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788636530.987846:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788636530.987847:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636530.987848:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636530.987849:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636530.987850:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636530.987851:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636530.987852:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636530.987853:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636530.987853:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636530.987854:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636530.987872:0:7451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788636530.987884:0:7451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000076ae40a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891840:0@lo:253: 00000100:00100000:2.0:1788636530.987922:0:7451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636530.987945:0:7451:0:(client.c:2716:ptlrpc_set_wait()) set 0000000033ac44f4 going to sleep for 11 seconds 40000000:00080000:3.0:1788636530.988168:0:7470:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:1.0:1788636530.988323:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225891712 00000100:00100000:1.0:1788636530.988331:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225891712 00000100:00100000:1.0:1788636530.988373:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788636530.988379:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068f7d26a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521225891712:12345-0@lo:38: 00010000:00080000:1.0:1788636530.988402:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1788636530.988432:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5b741ef42e837ee3 00000004:00100000:1.0:1788636530.988446:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788636530.988477:0:6521:0:(import.c:65:import_set_state_nolock()) 000000007ec8a00a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636530.988540:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068f7d26a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875521225891712:12345-0@lo:38: Request processed in 159us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636530.988547:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788636530.988656:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b26a2d5e x1875521225891712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636530.988666:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788636530.988674:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788636530.988751:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788636530.988755:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788636530.988757:0:3645:0:(import.c:65:import_set_state_nolock()) 000000001760aced lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788636530.988763:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b26a2d5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521225891712:0@lo:38: 00000100:00100000:2.0:1788636530.988889:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225891840 00000100:00100000:2.0:1788636530.988894:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225891840 00000100:00100000:2.0:1788636530.988932:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788636530.988938:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075320b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7451:x1875521225891840:12345-0@lo:253: 20000000:01000000:2.0:1788636530.988966:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788636530.988979:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788636530.990595:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788636530.997994:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788636530.998019:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788636530.998220:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788636530.998225:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788636530.998244:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.998266:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d2b427de/0x5b741ef42e837e0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837e03 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.998274:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005907e2b2/0x5b741ef42e837eb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837eab expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.998281:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.998327:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005907e2b2/0x5b741ef42e837eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837eab expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.998358:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005907e2b2/0x5b741ef42e837eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837eab expref: 15 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.998377:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6169b8e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225891968:0@lo:104: 00000100:00100000:1.0:1788636530.998457:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636530.998516:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d2b427de/0x5b741ef42e837e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837e03 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.998523:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d2b427de/0x5b741ef42e837e0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837e03 expref: 15 pid: 6516 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.998531:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf89595a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225892096:0@lo:104: 00000100:00100000:1.0:1788636530.998565:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.998598:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d79cc98f going to sleep for 11 seconds 00000100:00100000:1.0:1788636530.998633:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225891968 00000100:00100000:1.0:1788636530.998643:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225891968 00000100:00100000:2.0:1788636530.998851:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225892096 00000100:00100000:2.0:1788636530.998856:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225892096 00000100:00100000:2.0:1788636530.998881:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636530.998889:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b584ff2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6537:x1875521225891968:12345-0@lo:104: 00010000:00010000:2.0:1788636530.998903:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.998963:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636530.998967:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b584ff2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6537:x1875521225891968:12345-0@lo:104: Request processed in 80us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636530.998975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636530.998997:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636530.999002:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e39caf99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6537:x1875521225892096:12345-0@lo:104: 00010000:00010000:2.0:1788636530.999009:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999052:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788636530.999056:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e39caf99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6537:x1875521225892096:12345-0@lo:104: Request processed in 55us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636530.999063:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788636530.999080:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788636530.999085:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999092:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee3e54fa already unused, calling callback (00000000e0381c25) 10000000:00010000:2.0:1788636530.999096:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999103:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636530.999109:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636530.999115:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636530.999158:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999166:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636530.999181:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999188:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: 00000000ee3e54fa/0x5b741ef42e837eab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837eb2 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999214:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636530.999217:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999222:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d61433d0 already unused, calling callback (00000000e0381c25) 10000000:00010000:2.0:1788636530.999225:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999231:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636530.999236:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636530.999241:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636530.999255:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999261:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636530.999275:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999282:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: 00000000d61433d0/0x5b741ef42e837e03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837e0a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.999294:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636530.999296:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636530.999297:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636530.999302:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636530.999323:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636530.999336:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d46b0122 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225892352:0@lo:103: 00000100:00100000:2.0:1788636530.999370:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.999535:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0928256 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225892224:0@lo:103: 00000100:00100000:1.0:1788636530.999574:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.999627:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225892352 00000100:00100000:1.0:1788636530.999633:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225892352 00010000:00010000:1.0:1788636530.999655:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d2b427de/0x5b741ef42e837e0a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837e03 expref: 16 pid: 6516 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.999679:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225892224 00000100:00100000:1.0:1788636530.999840:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225892224 00010000:00010000:1.0:1788636530.999855:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005907e2b2/0x5b741ef42e837eb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837eab expref: 17 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636530.999870:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636530.999885:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037508ef9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:3649:x1875521225892352:12345-0@lo:103: 00010000:00010000:1.0:1788636530.999897:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636530.999901:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d2b427de/0x5b741ef42e837e0a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837e03 expref: 17 pid: 6516 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.999910:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d2b427de/0x5b741ef42e837e0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837e03 expref: 17 pid: 6516 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636530.999927:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636530.999956:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037508ef9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:3649:x1875521225892352:12345-0@lo:103: Request processed in 73us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636530.999963:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636530.999980:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636530.999985:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059f178a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:3647:x1875521225892224:12345-0@lo:103: 00010000:00010000:1.0:1788636530.999991:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636530.999994:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005907e2b2/0x5b741ef42e837eb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837eab expref: 16 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000002:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005907e2b2/0x5b741ef42e837eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837eab expref: 16 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000012:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000020:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788636531.000034:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004664106s 00010000:00010000:1.0:1788636531.000037:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000052:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000057:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000063:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000068:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b4762141 already unused, calling callback (00000000ea3c6fd1) 00010000:00010000:1.0:1788636531.000071:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000077:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000084:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000095:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636531.000120:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059f178a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:3647:x1875521225892224:12345-0@lo:103: Request processed in 135us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636531.000126:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636531.000257:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0928256 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225892224:0@lo:103: 00000100:00100000:1.0:1788636531.000283:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d46b0122 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225892352:0@lo:103: 00010000:00010000:1.0:1788636531.000305:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005907e2b2/0x5b741ef42e837eb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837eab expref: 15 pid: 6513 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636531.000317:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6169b8e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225891968:0@lo:104: 00010000:00010000:1.0:1788636531.000337:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d2b427de/0x5b741ef42e837e0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837e03 expref: 14 pid: 6516 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636531.000345:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf89595a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225892096:0@lo:104: 00010000:00010000:1.0:1788636531.000360:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000369:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000374:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636531.000379:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b4762141/0x5b741ef42e837eea lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636531.000928:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075320b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:7451:x1875521225891840:12345-0@lo:253: Request processed in 11987us (13002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636531.000938:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788636531.001346:0:7451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000076ae40a pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7451:1875521225891840:0@lo:253: 10000000:01000000:2.0:1788636531.001358:0:7451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788636531.001361:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636531.001363:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788636531.001364:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636531.001365:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636531.001366:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636531.001367:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636531.001369:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636531.001370:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636531.001371:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636531.001373:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636531.001374:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788636531.001387:0:7451:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788636531.007323:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:2.0:1788636531.008364:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788636531.009021:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788636531.009313:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788636531.010412:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788636531.010665:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788636531.011644:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788636531.012105:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788636531.012347:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788636531.012470:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788636531.012781:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788636531.013013:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788636531.015211:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788636531.015452:0:7474:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788636531.015457:0:7474:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788636531.015517:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788636531.015618:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000076ae40a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875521225892480:0@lo:700: 00000100:00100000:2.0:1788636531.015785:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636531.015851:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 000000008303a455 going to sleep for 11 seconds 00000100:00100000:1.0:1788636531.015915:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225892480 00000100:00100000:1.0:1788636531.015923:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225892480 00000100:00100000:1.0:1788636531.015971:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636531.015977:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009508cb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1875521225892480:12345-0@lo:700: 00000040:01000000:3.0:1788636531.016247:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788636531.016524:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000013badb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875521225892608:0@lo:1000: 00000100:00100000:3.0:1788636531.016577:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636531.016618:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a681a073 going to sleep for 11 seconds 00000100:00100000:1.0:1788636531.016767:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225892608 00000100:00100000:1.0:1788636531.016772:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225892608 00000100:00100000:1.0:1788636531.016841:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788636531.016848:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000615af0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875521225892608:12345-0@lo:1000: 00000100:00100000:1.0:1788636531.016913:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000615af0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875521225892608:12345-0@lo:1000: Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636531.016920:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:2.0:1788636531.017419:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788636531.017519:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788636531.018127:0:7451:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788636531.018136:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 40000000:02000000:1.0:1788636531.019480:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1788636531.020858:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000013badb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875521225892608:0@lo:1000: 00000040:01000000:3.0:1788636531.020904:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788636531.020945:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000013badb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875521225892736:0@lo:700: 00000100:00100000:3.0:1788636531.020999:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636531.021050:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f1db937 going to sleep for 11 seconds 00000100:00100000:2.0:1788636531.021130:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225892736 00000100:00100000:2.0:1788636531.021137:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225892736 00000100:00100000:2.0:1788636531.021271:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636531.021280:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc13135a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875521225892736:12345-0@lo:700: 00000100:00100000:2.0:1788636531.021334:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc13135a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875521225892736:12345-0@lo:700: Request processed in 56us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636531.021341:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1788636531.021651:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788636531.022844:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000013badb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875521225892736:0@lo:700: 00000100:00100000:3.0:1788636531.022912:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000013badb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1875521225892864:0@lo:900: 00000100:00100000:3.0:1788636531.022962:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636531.023001:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225892864 00000100:00100000:3.0:1788636531.023016:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225892864 00000100:00100000:3.0:1788636531.023054:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636531.023061:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e0abde5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1875521225892864:12345-0@lo:900: 00000100:00100000:3.0:1788636531.023099:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e0abde5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1875521225892864:12345-0@lo:900: Request processed in 39us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636531.023106:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636531.023125:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f1db937 going to sleep for 11 seconds 00010000:00080000:3.0:1788636531.023137:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000013badb4 x1875521225892864/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788636547 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636531.023227:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000013badb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1875521225892864:0@lo:900: 00000100:00100000:3.0:1788636531.023287:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000013badb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875521225892992:0@lo:1000: 00000100:00100000:3.0:1788636531.023327:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636531.023352:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e67f7e8 going to sleep for 11 seconds 00000100:00100000:0.0:1788636531.024462:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225892992 00000100:00100000:0.0:1788636531.024470:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225892992 00000040:00080000:2.0:1788636531.025127:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1788636531.027303:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636531.027326:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6c17a75 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875521225892992:12345-0@lo:1000: 00000100:00100000:0.0:1788636531.027498:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6c17a75 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875521225892992:12345-0@lo:1000: Request processed in 181us (4170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636531.027507:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1788636531.027836:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788636531.027900:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788636531.028316:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788636531.028606:0:7451:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788636531.030462:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:1.0:1788636531.031004:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009508cb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1875521225892480:12345-0@lo:700: Request processed in 15023us (15318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636531.031017:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636531.031259:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000013badb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875521225892992:0@lo:1000: 00000004:00080000:3.0:1788636531.031325:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000000f1db937 with version 0 00000020:00100000:3.0:1788636531.031349:0:7476:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788636531.031355:0:7476:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000013badb4 x1875521225893248/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788636531.031375:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000013badb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875521225893248:0@lo:1000: 00000100:00100000:3.0:1788636531.031411:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636531.031458:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f25a2772 going to sleep for 11 seconds 00010000:00080000:2.0:1788636531.031650:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000076ae40a x1875521225892480/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788636547 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636531.031661:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000076ae40a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875521225892480:0@lo:700: 40000000:02000000:2.0:1788636531.031671:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:0.0:1788636531.031798:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225893248 00000100:00100000:0.0:1788636531.031827:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225893248 00000100:00100000:0.0:1788636531.031872:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636531.031879:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6b7f895 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875521225893248:12345-0@lo:1000: 00100000:10000000:3.0:1788636531.032997:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788636531.034337:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788636531.035306:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788636531.037251:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000001:00080000:1.0:1788636531.038387:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:3.0:1788636531.041551:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788636531.044422:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788636531.044631:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788636531.044837:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788636531.044969:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788636531.045094:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788636531.045215:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788636531.045370:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788636531.045494:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788636531.045662:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788636531.045799:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788636531.046132:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788636531.046248:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788636531.046392:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788636531.046524:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788636531.046732:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788636531.046905:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788636531.047031:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788636531.047170:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788636531.047288:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788636531.047399:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788636531.047532:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000100:00100000:0.0:1788636531.049391:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6b7f895 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875521225893248:12345-0@lo:1000: Request processed in 17505us (17972us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788636531.049406:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1788636531.049517:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788636531.049522:0:7476:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788636531.049618:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000013badb4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875521225893248:0@lo:1000: 00000100:00100000:1.0:1788636531.049775:0:7476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf89595a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875521225893376:0@lo:1000: 00000100:00100000:1.0:1788636531.049848:0:7476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636531.049890:0:7476:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b99317f going to sleep for 11 seconds 00000100:00100000:0.0:1788636531.049954:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225893376 00000100:00100000:0.0:1788636531.049962:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225893376 00000100:00100000:0.0:1788636531.050004:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788636531.050012:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6169b8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875521225893376:12345-0@lo:1000: 00000100:00100000:0.0:1788636531.050073:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6169b8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875521225893376:12345-0@lo:1000: Request processed in 62us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636531.050079:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636531.050233:0:7476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf89595a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875521225893376:0@lo:1000: 00000040:00080000:1.0:1788636531.050254:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788636531.050283:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000befdd5d0 with version 1 00100000:10000000:3.0:1788636531.051919:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788636531.052067:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788636531.052738:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788636531.052910:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788636531.053033:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788636531.053668:0:7451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788636531.057532:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788636531.057762:0:7451:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788636531.057797:0:7451:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb25401ceb988 00100000:10000000:3.0:1788636531.057824:0:7451:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000004:00080000:0.0:1788636531.061632:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000047878332 version 1 rpc_version 1 00000020:00100000:0.0:1788636531.061892:0:7466:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788636531.061904:0:7466:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d16374b0 x1875521225893632/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636531.061934:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1875521225893632:0@lo:1000: 00000100:00100000:0.0:1788636531.062014:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636531.062077:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000004919c9f5 going to sleep for 11 seconds 00000100:00100000:0.0:1788636531.062102:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225893632 00000100:00100000:0.0:1788636531.062109:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225893632 00000040:00080000:1.0:1788636531.062379:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788636531.062472:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788636531.063837:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636531.063856:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099eb9699 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875521225893632:12345-0@lo:1000: 00000020:01000004:2.0:1788636531.064597:0:7451:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788636531.064628:0:7451:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788636531.064654:0:7451:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788636531.064673:0:7451:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:3.0:1788636531.068203:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788636531.068301:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788636531.068306:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:3.0:1788636531.072307:0:7451:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636531.072504:0:7451:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:1.0:1788636531.076998:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788636531.077126:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099eb9699 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875521225893632:12345-0@lo:1000: Request processed in 13275us (15108us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788636531.077139:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788636531.077801:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788636531.084295:0:7466:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788636531.084325:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1875521225893632:0@lo:1000: 00010000:00010000:2.0:1788636531.990180:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636533.015155:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636534.052850:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636535.063141:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636536.086501:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636536.469240:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f3bf6ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225894144:0@lo:400: 00000100:00100000:3.0:1788636536.469336:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636536.469394:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636536.469400:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009606e33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225893760:0@lo:400: 00000100:00100000:3.0:1788636536.469428:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636536.469480:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d30eb44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225893888:0@lo:400: 00000100:00100000:3.0:1788636536.469507:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636536.469527:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636536.469531:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be7b2c01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225894016:0@lo:400: 00000100:00100000:3.0:1788636536.469555:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636536.469592:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225894144 00000100:00100000:3.0:1788636536.469602:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225894144 00000100:00100000:3.0:1788636536.469646:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225893888 00000100:00100000:3.0:1788636536.469649:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225893888 00000100:00100000:3.0:1788636536.469665:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636536.469672:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bba502b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225894144:12345-0@lo:400: 00000100:00100000:3.0:1788636536.469745:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bba502b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225894144:12345-0@lo:400: Request processed in 73us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636536.469753:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636536.469774:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788636536.469779:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000013badb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225893888:12345-0@lo:400: 00000100:00100000:3.0:1788636536.469834:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000013badb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225893888:12345-0@lo:400: Request processed in 55us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636536.469837:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225893760 00000100:00100000:3.0:1788636536.469840:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636536.469841:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225893760 00000100:00100000:0.0:1788636536.469870:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788636536.469875:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2bbbb85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:3648:x1875521225893760:12345-0@lo:400: 00010000:00080000:3.0:1788636536.469879:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009d30eb44 x1875521225893888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636536.469893:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d30eb44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225893888:0@lo:400: 00000100:00100000:0.0:1788636536.469904:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2bbbb85 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:3648:x1875521225893760:12345-0@lo:400: Request processed in 30us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636536.469910:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636536.469918:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009606e33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225893760:0@lo:400: 00010000:00080000:3.0:1788636536.469926:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000f3bf6ce x1875521225894144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636536.469934:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f3bf6ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225894144:0@lo:400: 00000100:00100000:0.0:1788636536.469937:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225894016 00000100:00100000:0.0:1788636536.469940:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225894016 00000100:00100000:0.0:1788636536.469960:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788636536.469967:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033490efc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225894016:12345-0@lo:400: 00000100:00100000:0.0:1788636536.470013:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033490efc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225894016:12345-0@lo:400: Request processed in 47us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636536.470019:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636536.470367:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be7b2c01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225894016:0@lo:400: 00000100:00100000:2.0:1788636536.470945:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225894272:0@lo:41: 00000100:00100000:2.0:1788636536.470989:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636536.471147:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225894272 00000100:00100000:0.0:1788636536.471154:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225894272 00000100:00100000:0.0:1788636536.471191:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636536.471198:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000076ae40a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225894272:12345-0@lo:41: 00000004:00000024:0.0:1788636536.471225:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788636536.471288:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000076ae40a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225894272:12345-0@lo:41: Request processed in 79us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636536.471295:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636536.471331:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225894272:0@lo:41: 00000001:02000400:3.0:1788636536.491551:0:7720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788636537.109649:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788636537.524448:0:7773:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788636537.524646:0:7773:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788636538.135641:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636539.157682:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636540.183400:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788636540.515558:0:7874:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636540.515790:0:7874:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788636540.566091:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788636540.566100:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf00f150000 from 4 10000000:01000000:2.0:1788636540.566115:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788636540.566163:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 00000000ee44cc6d/0x5b741ef42e837ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636540.566176:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 00000000ee44cc6d/0x5b741ef42e837ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636540.566186:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 00000000ee44cc6d/0x5b741ef42e837ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636540.566213:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc8fdf4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225894400:0@lo:101: 00000100:00100000:2.0:1788636540.566299:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636540.566382:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b99cf976 going to sleep for 11 seconds 00000100:00100000:0.0:1788636540.566564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225894400 00000100:00100000:0.0:1788636540.566573:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225894400 00000100:00100000:0.0:1788636540.566628:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788636540.566644:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049c1bc33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:6519:x1875521225894400:12345-0@lo:101: 00010000:00010000:0.0:1788636540.566659:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636540.566672:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837ef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837ef1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.566696:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837ef1 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.566706:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001b4d6f11/0x5b741ef42e837ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837ef1 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.566716:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001b4d6f11, rc 0) 00000100:00100000:0.0:1788636540.566764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049c1bc33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:6519:x1875521225894400:12345-0@lo:101: Request processed in 122us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.566770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788636540.566864:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc8fdf4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225894400:0@lo:101: 00010000:00010000:1.0:1788636540.566879:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 00000000ee44cc6d/0x5b741ef42e837ef1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636540.566888:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 00000000ee44cc6d/0x5b741ef42e837ef1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636540.566959:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf89595a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225894528:0@lo:256: 00000100:00100000:1.0:1788636540.566991:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636540.567014:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5f992bf going to sleep for 11 seconds 00000100:00100000:0.0:1788636540.567144:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225894528 00000100:00100000:0.0:1788636540.567149:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225894528 00000100:00100000:0.0:1788636540.567172:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788636540.567178:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf8e43d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:6519:x1875521225894528:12345-0@lo:256: 20000000:01000000:0.0:1788636540.567192:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788636540.567212:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788636540.567215:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788636540.567291:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf8e43d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:6519:x1875521225894528:12345-0@lo:256: Request processed in 113us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.567299:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788636540.567325:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf89595a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225894528:0@lo:256: 10000000:01000000:0.0:1788636540.567380:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788636540.567386:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 00000000ee44cc6d/0x5b741ef42e837ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.567393:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 00000000ee44cc6d/0x5b741ef42e837ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636540.567401:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788636540.567403:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00324c000 from 21 10000000:01000000:0.0:1788636540.567405:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788636540.567421:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 000000005567536f/0x5b741ef42e837eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.567426:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 000000005567536f/0x5b741ef42e837eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.567433:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 000000005567536f/0x5b741ef42e837eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636540.567443:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225894656:0@lo:101: 00000100:00100000:0.0:1788636540.567465:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.567478:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:0.0:1788636540.567488:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225894656 00000100:00100000:0.0:1788636540.567491:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225894656 00000100:00100000:0.0:1788636540.567512:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788636540.567516:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000988aaf13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:6519:x1875521225894656:12345-0@lo:101: 00010000:00010000:0.0:1788636540.567523:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636540.567530:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000075c0f1fd/0x5b741ef42e837f06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837eff expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.567543:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000075c0f1fd/0x5b741ef42e837f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837eff expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.567550:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000075c0f1fd/0x5b741ef42e837f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837eff expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.567556:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000075c0f1fd, rc 0) 00000100:00100000:0.0:1788636540.567582:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000988aaf13 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225894656:12345-0@lo:101: Request processed in 65us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.567587:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788636540.567616:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225894656:0@lo:101: 00010000:00010000:0.0:1788636540.567626:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 000000005567536f/0x5b741ef42e837eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.567642:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 000000005567536f/0x5b741ef42e837eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636540.567956:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225894784:0@lo:501: 00000100:00100000:0.0:1788636540.567982:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.568112:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:1.0:1788636540.581289:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225894784 00000100:00100000:1.0:1788636540.581310:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225894784 00000100:00100000:0.0:1788636540.581485:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636540.581497:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f7f0a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225894784:12345-0@lo:501: 00000100:00100000:0.0:1788636540.581695:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f7f0a65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225894784:12345-0@lo:501: Request processed in 200us (13712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.581703:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636540.581743:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225894784:0@lo:501: 00000100:00100000:0.0:1788636540.581791:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225894912:0@lo:503: 00000100:00100000:0.0:1788636540.581972:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.581992:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:0.0:1788636540.582006:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225894912 00000100:00100000:0.0:1788636540.582010:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225894912 00000100:00100000:0.0:1788636540.582025:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788636540.582030:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bd0f95d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225894912:12345-0@lo:503: 00000100:00100000:0.0:1788636540.582105:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bd0f95d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225894912:12345-0@lo:503: Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.582112:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788636540.582157:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225894912:0@lo:503: 00000100:00100000:0.0:1788636540.582533:0:7877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7877:1875521225895040:0@lo:502: 00000100:00100000:0.0:1788636540.582570:0:7877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.582591:0:7877:0:(client.c:2716:ptlrpc_set_wait()) set 000000005af2c3d6 going to sleep for 11 seconds 00000100:00100000:1.0:1788636540.582641:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225895040 00000100:00100000:1.0:1788636540.582646:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225895040 00000100:00100000:1.0:1788636540.582678:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788636540.582684:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7df4593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7877:x1875521225895040:12345-0@lo:502: 00000100:00100000:1.0:1788636540.582764:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7df4593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7877:x1875521225895040:12345-0@lo:502: Request processed in 80us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636540.582770:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788636540.582876:0:7877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7877:1875521225895040:0@lo:502: 00000100:00100000:0.0:1788636540.582918:0:7877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7877:1875521225895168:0@lo:502: 00000100:00100000:0.0:1788636540.582951:0:7877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.582968:0:7877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:1.0:1788636540.583017:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225895168 00000100:00100000:1.0:1788636540.583021:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225895168 00000100:00100000:1.0:1788636540.583048:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788636540.583053:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b9acc66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7877:x1875521225895168:12345-0@lo:502: 00000100:00100000:1.0:1788636540.583110:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b9acc66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:7877:x1875521225895168:12345-0@lo:502: Request processed in 57us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636540.583116:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788636540.583249:0:7877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7877:1875521225895168:0@lo:502: 00000040:00080000:0.0:1788636540.583270:0:7877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788636540.583342:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788636540.583378:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788636540.583388:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 000000005567536f/0x5b741ef42e837eff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636540.583931:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 000000005567536f/0x5b741ef42e837eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636540.583944:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788636540.583947:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf00324c000 from 4 10000000:01000000:3.0:1788636540.583949:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788636540.583974:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 0000000037205808/0x5b741ef42e837f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636540.583981:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 0000000037205808/0x5b741ef42e837f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636540.583990:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 0000000037205808/0x5b741ef42e837f0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636540.584005:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be7b2c01 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225895296:0@lo:101: 00000100:00100000:3.0:1788636540.584044:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636540.584066:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a51e493b going to sleep for 11 seconds 00000100:00100000:2.0:1788636540.584848:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225895296 00000100:00100000:2.0:1788636540.584857:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225895296 00000100:00100000:2.0:1788636540.584897:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788636540.584905:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000443fc105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225895296:12345-0@lo:101: 00010000:00010000:2.0:1788636540.584917:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636540.584930:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000007232a3/0x5b741ef42e837f14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837f0d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636540.584951:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000007232a3/0x5b741ef42e837f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837f0d expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636540.584977:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000007232a3/0x5b741ef42e837f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f0d expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636540.584987:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000007232a3, rc 0) 00000100:00100000:2.0:1788636540.585035:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000443fc105 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225895296:12345-0@lo:101: Request processed in 131us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636540.585042:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788636540.585088:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be7b2c01 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225895296:0@lo:101: 00010000:00010000:2.0:1788636540.585115:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 0000000037205808/0x5b741ef42e837f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636540.585124:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 0000000037205808/0x5b741ef42e837f0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636540.585170:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008919e681 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225895424:0@lo:256: 00000100:00100000:2.0:1788636540.585203:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636540.585226:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c87ef4b0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636540.585241:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225895424 00000100:00100000:2.0:1788636540.585245:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225895424 00000100:00100000:2.0:1788636540.585269:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788636540.585275:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d764ef6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225895424:12345-0@lo:256: 20000000:01000000:2.0:1788636540.585289:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788636540.585306:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788636540.585309:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788636540.585406:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d764ef6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225895424:12345-0@lo:256: Request processed in 132us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636540.585413:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788636540.588706:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008919e681 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225895424:0@lo:256: 10000000:01000000:0.0:1788636540.588775:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788636540.588785:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 0000000037205808/0x5b741ef42e837f0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.588795:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 0000000037205808/0x5b741ef42e837f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636540.588825:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788636540.588828:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788636540.588831:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788636540.588866:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 000000008e55f44d/0x5b741ef42e837f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.588874:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 000000008e55f44d/0x5b741ef42e837f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.588882:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 000000008e55f44d/0x5b741ef42e837f1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636540.588897:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225895552:0@lo:101: 00000100:00100000:0.0:1788636540.588948:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.588985:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:0.0:1788636540.589006:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225895552 00000100:00100000:0.0:1788636540.589013:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225895552 00000100:00100000:0.0:1788636540.589060:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636540.589068:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f3320d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225895552:12345-0@lo:101: 00010000:00010000:0.0:1788636540.589083:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636540.589094:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5143cae/0x5b741ef42e837f22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837f1b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.589140:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5143cae/0x5b741ef42e837f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837f1b expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.589150:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5143cae/0x5b741ef42e837f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f1b expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.589158:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5143cae, rc 0) 00000100:00100000:0.0:1788636540.589199:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f3320d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225895552:12345-0@lo:101: Request processed in 132us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.589207:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636540.589251:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225895552:0@lo:101: 00010000:00010000:0.0:1788636540.589263:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 000000008e55f44d/0x5b741ef42e837f1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.589272:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 000000008e55f44d/0x5b741ef42e837f1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636540.589322:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225895680:0@lo:501: 00000100:00100000:0.0:1788636540.589342:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.589378:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:3.0:1788636540.589400:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225895680 00000100:00100000:3.0:1788636540.589417:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225895680 00000100:00100000:3.0:1788636540.589452:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788636540.589458:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9c89676 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225895680:12345-0@lo:501: 00000100:00100000:3.0:1788636540.589581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9c89676 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225895680:12345-0@lo:501: Request processed in 124us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636540.589590:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788636540.594187:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225895680:0@lo:501: 00000100:00100000:0.0:1788636540.594256:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225895808:0@lo:503: 00000100:00100000:0.0:1788636540.594338:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.594394:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:1.0:1788636540.594403:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225895808 00000100:00100000:1.0:1788636540.594413:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225895808 00000100:00100000:1.0:1788636540.594464:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788636540.594473:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005760eb9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225895808:12345-0@lo:503: 00000100:00100000:1.0:1788636540.594595:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005760eb9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225895808:12345-0@lo:503: Request processed in 123us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636540.594603:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788636540.597215:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225895808:0@lo:503: 00000100:00100000:0.0:1788636540.597731:0:7879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7879:1875521225895936:0@lo:502: 00000100:00100000:0.0:1788636540.597798:0:7879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636540.597903:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225895936 00000100:00100000:2.0:1788636540.597911:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225895936 00000100:00100000:0.0:1788636540.597929:0:7879:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:2.0:1788636540.597964:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788636540.597973:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017a9b778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:7879:x1875521225895936:12345-0@lo:502: 00000100:00100000:2.0:1788636540.598100:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017a9b778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:7879:x1875521225895936:12345-0@lo:502: Request processed in 128us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.598122:0:7879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7879:1875521225895936:0@lo:502: 00000020:01000000:0.0:1788636540.598159:0:7879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636540.598172:0:7879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636540.598175:0:7879:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788636540.598181:0:7879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788636540.598184:0:7879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000100:00100000:2.0:1788636540.598205:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000020:00000080:0.0:1788636540.598213:0:7879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636540.598230:0:7879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000bc392263) 00000020:00000080:0.0:1788636540.598256:0:7879:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788636540.598263:0:7879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788636540.599020:0:7879:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788636540.599032:0:7879:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788636540.599041:0:7879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e837f30 00010000:00080000:0.0:1788636540.599075:0:7879:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000031376976@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.126@tcp at head 00010000:00010000:0.0:1788636540.606663:0:7879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1788636540.608972:0:7879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788636540.608985:0:7879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788636540.609021:0:7879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788636540.609042:0:7879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e837f37 00000100:00080000:0.0:1788636540.609053:0:7879:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788636540.609058:0:7879:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000031376976 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636540.609093:0:7879:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d16374b0 x1875521225896064/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636540.609117:0:7879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788636540.609141:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521225896064:0@lo:38: 00000040:01000000:0.0:1788636540.609161:0:7879:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1788636540.609220:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.609387:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225896064 00000100:00100000:0.0:1788636540.609395:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225896064 00000100:00100000:0.0:1788636540.609441:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636540.609448:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd206d18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875521225896064:12345-0@lo:38: 00010000:00080000:0.0:1788636540.609576:0:6526:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1788636540.609611:0:6526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e837f3e 00000004:00100000:0.0:1788636540.609643:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788636540.609650:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788636540.609704:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff0b563f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225896192:0@lo:400: 00000100:00100000:2.0:1788636540.609741:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636540.609783:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225896192 00000100:00100000:2.0:1788636540.609789:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225896192 00000020:01000000:0.0:1788636540.609837:0:7879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636540.609843:0:7879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1788636540.609846:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000020:00000080:0.0:1788636540.609847:0:7879:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788636540.609853:0:7879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1788636540.609857:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008919e681 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225896192:12345-0@lo:400: 00000020:00000080:0.0:1788636540.609858:0:7879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636540.609862:0:7879:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788636540.609868:0:7879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788636540.609869:0:7879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788636540.609894:0:7879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000705a2cc pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7879:1875521225896320:0@lo:502: 00000100:00100000:2.0:1788636540.609909:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008919e681 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225896192:12345-0@lo:400: Request processed in 55us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636540.609916:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788636540.609945:0:7879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788636540.609954:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ff0b563f x1875521225896192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636540.610263:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff0b563f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225896192:0@lo:400: 00000100:00100000:2.0:1788636540.610279:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636540.610284:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000562b64be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225896448:0@lo:400: 00000100:00100000:2.0:1788636540.610308:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636540.610335:0:6527:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788636540.610341:0:6527:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788636540.610464:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225896448 00000100:00100000:2.0:1788636540.610473:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225896448 00000100:00100000:2.0:1788636540.610562:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636540.610568:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc8fdf4e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225896448:12345-0@lo:400: 00000100:00100000:2.0:1788636540.610601:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc8fdf4e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225896448:12345-0@lo:400: Request processed in 34us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636540.610607:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636540.610629:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000562b64be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225896448:0@lo:400: 00000100:00080000:3.0:1788636540.614956:0:7883:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000000f3bf6ce x1875521225896704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636540.614983:0:7883:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f8576a3 going to sleep for 0 seconds 00000100:00100000:2.0:1788636540.617924:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225896320 00000100:00100000:0.0:1788636540.617929:0:7879:0:(client.c:2716:ptlrpc_set_wait()) set 0000000033b40257 going to sleep for 11 seconds 00000100:00100000:2.0:1788636540.617940:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225896320 00000100:00100000:2.0:1788636540.618004:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788636540.618014:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000308b4d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:7879:x1875521225896320:12345-0@lo:502: 00000100:00100000:2.0:1788636540.618168:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000308b4d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:7879:x1875521225896320:12345-0@lo:502: Request processed in 156us (8226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636540.618177:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788636540.618575:0:7879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000705a2cc pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:7879:1875521225896320:0@lo:502: 00000020:01000000:0.0:1788636540.618610:0:7879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636540.618627:0:7879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636540.618630:0:7879:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788636540.618642:0:7879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788636540.618711:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788636540.618731:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788636540.618740:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 000000008e55f44d/0x5b741ef42e837f1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.618750:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 000000008e55f44d/0x5b741ef42e837f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636540.618769:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788636540.618772:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf040b3b380 from 1 10000000:01000000:0.0:1788636540.618774:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788636540.618837:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 00000000f417ee41/0x5b741ef42e837f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.618845:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 00000000f417ee41/0x5b741ef42e837f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.618854:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 00000000f417ee41/0x5b741ef42e837f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636540.618871:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000705a2cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225896832:0@lo:101: 00000100:00100000:0.0:1788636540.618911:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.618937:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:2.0:1788636540.619658:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225896832 00000100:00100000:2.0:1788636540.619667:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225896832 00000100:00100000:2.0:1788636540.619710:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788636540.619717:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c90d43da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225896832:12345-0@lo:101: 00010000:00010000:2.0:1788636540.619729:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636540.619742:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c90de68a/0x5b741ef42e837f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837f45 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636540.619766:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c90de68a/0x5b741ef42e837f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837f45 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636540.619776:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c90de68a/0x5b741ef42e837f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f45 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636540.619840:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c90de68a, rc 0) 00000100:00100000:0.0:1788636540.620675:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636540.620696:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a23a11a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225896576:0@lo:400: 00000100:00100000:0.0:1788636540.620779:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636540.620864:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225896576 00000100:00100000:1.0:1788636540.620872:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225896576 00000100:00100000:1.0:1788636540.620923:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788636540.620931:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000685e877e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225896576:12345-0@lo:400: 00000100:00100000:1.0:1788636540.620981:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000685e877e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225896576:12345-0@lo:400: Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636540.620988:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788636540.621161:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a23a11a5 x1875521225896576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636540.621175:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a23a11a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225896576:0@lo:400: 00000100:00100000:2.0:1788636540.621741:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c90d43da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225896832:12345-0@lo:101: Request processed in 2022us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636540.621749:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788636540.621895:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000705a2cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225896832:0@lo:101: 00010000:00010000:0.0:1788636540.621917:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 00000000f417ee41/0x5b741ef42e837f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.621928:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 00000000f417ee41/0x5b741ef42e837f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636540.622012:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000705a2cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225896960:0@lo:501: 00000100:00100000:0.0:1788636540.622045:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.622073:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:1.0:1788636540.622239:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225896960 00000100:00100000:1.0:1788636540.622245:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225896960 00000100:00100000:1.0:1788636540.622281:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788636540.622287:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0123e35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225896960:12345-0@lo:501: 00000100:00100000:1.0:1788636540.622379:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0123e35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225896960:12345-0@lo:501: Request processed in 93us (335us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788636540.622386:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788636540.624203:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000705a2cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225896960:0@lo:501: 10000000:01000000:0.0:1788636540.624253:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788636540.624263:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: 00000000f417ee41/0x5b741ef42e837f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636540.624273:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: 00000000f417ee41/0x5b741ef42e837f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788636540.625797:0:6526:0:(import.c:65:import_set_state_nolock()) 0000000063fcd914 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636540.626155:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd206d18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875521225896064:12345-0@lo:38: Request processed in 16705us (16935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636540.626166:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636540.626279:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788636540.626289:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788636540.626298:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788636540.626304:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788636540.626306:0:3645:0:(import.c:65:import_set_state_nolock()) 0000000031376976 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788636540.626331:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008f8576a3): req@000000000f3bf6ce x1875521225896704/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636540.626359:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521225896064:0@lo:38: 00000100:00100000:0.0:1788636540.626506:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636540.626519:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000705a2cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225897088:0@lo:41: 00000100:00100000:0.0:1788636540.626569:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.626618:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225897088 00000100:00100000:0.0:1788636540.626624:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225897088 00000100:00100000:0.0:1788636540.626663:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788636540.626671:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001703cb96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521225897088:12345-0@lo:41: 00000004:00000024:0.0:1788636540.626702:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788636540.626735:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001703cb96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521225897088:12345-0@lo:41: Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.626741:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788636540.626766:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000705a2cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225897088:0@lo:41: 00000100:00100000:1.0:1788636540.627865:0:7883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636540.628335:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225896704 00000100:00100000:2.0:1788636540.628343:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225896704 00000100:00100000:2.0:1788636540.628443:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636540.628452:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000304de4fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7883:x1875521225896704:12345-0@lo:1000: 00000100:00100000:2.0:1788636540.628567:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000304de4fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7883:x1875521225896704:12345-0@lo:1000: Request processed in 116us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636540.628574:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788636540.629300:0:7883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f3bf6ce pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225896704:0@lo:1000: 00000040:01000000:1.0:1788636540.629344:0:7883:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788636540.629403:0:7883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a23a11a5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225897216:0@lo:1000: 00000100:00100000:1.0:1788636540.629450:0:7883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636540.629549:0:7883:0:(client.c:2716:ptlrpc_set_wait()) set 00000000656e228b going to sleep for 11 seconds 00000100:00100000:0.0:1788636540.634384:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225897216 00000100:00100000:0.0:1788636540.634398:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225897216 00000100:00100000:0.0:1788636540.634497:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788636540.634507:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000562b64be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7883:x1875521225897216:12345-0@lo:1000: 00000100:00100000:0.0:1788636540.634729:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000562b64be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7883:x1875521225897216:12345-0@lo:1000: Request processed in 222us (5279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.634737:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788636540.635048:0:7883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a23a11a5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225897216:0@lo:1000: 00000100:00100000:0.0:1788636540.635201:0:7883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000705a2cc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225897344:0@lo:700: 00000100:00100000:0.0:1788636540.635239:0:7883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.635268:0:7883:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cab8b3ec going to sleep for 11 seconds 00000100:00100000:3.0:1788636540.635315:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225897344 00000100:00100000:3.0:1788636540.635320:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225897344 00000100:00100000:3.0:1788636540.635360:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636540.635378:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf12017c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7883:x1875521225897344:12345-0@lo:700: 00000100:00100000:3.0:1788636540.635440:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf12017c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7883:x1875521225897344:12345-0@lo:700: Request processed in 64us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636540.635447:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636540.635635:0:7883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000705a2cc pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225897344:0@lo:700: 00000100:00100000:1.0:1788636540.635859:0:7883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a23a11a5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225897472:0@lo:1000: 00000100:00100000:1.0:1788636540.635897:0:7883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636540.635929:0:7883:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083b4ce10 going to sleep for 11 seconds 00000100:00100000:0.0:1788636540.635952:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225897472 00000100:00100000:0.0:1788636540.635957:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225897472 00000100:00100000:0.0:1788636540.635991:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788636540.635998:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff0b563f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7883:x1875521225897472:12345-0@lo:1000: 00000100:00100000:0.0:1788636540.636052:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff0b563f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7883:x1875521225897472:12345-0@lo:1000: Request processed in 55us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.636058:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788636540.636085:0:7883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a23a11a5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225897472:0@lo:1000: 00000004:00080000:1.0:1788636540.636147:0:7883:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000dd80a89a with version 0 00000020:00100000:1.0:1788636540.636162:0:7883:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788636540.636170:0:7883:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a23a11a5 x1875521225897728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636540.636183:0:7883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a23a11a5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225897728:0@lo:1000: 00000100:00100000:1.0:1788636540.636209:0:7883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636540.636231:0:7883:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e849ef2a going to sleep for 11 seconds 00000100:00100000:1.0:1788636540.636246:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225897728 00000100:00100000:1.0:1788636540.636250:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225897728 00000100:00100000:1.0:1788636540.636274:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788636540.636281:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf89595a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7883:x1875521225897728:12345-0@lo:1000: 00000001:00080000:0.0:1788636540.644120:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788636540.644137:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788636540.644280:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf89595a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7883:x1875521225897728:12345-0@lo:1000: Request processed in 7983us (8054us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788636540.644300:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788636540.644352:0:7883:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788636540.644357:0:7883:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788636540.644383:0:7883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a23a11a5 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225897728:0@lo:1000: 00000100:00100000:0.0:1788636540.644482:0:7883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db17d9e0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225897856:0@lo:1000: 00000100:00100000:0.0:1788636540.644597:0:7883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636540.644704:0:7883:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4c478c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636540.644724:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225897856 00000100:00100000:0.0:1788636540.644737:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225897856 00000100:00100000:0.0:1788636540.644777:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636540.644784:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022e4efbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7883:x1875521225897856:12345-0@lo:1000: 00000100:00100000:0.0:1788636540.645131:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022e4efbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7883:x1875521225897856:12345-0@lo:1000: Request processed in 347us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636540.645138:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636540.645166:0:7883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db17d9e0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7883:1875521225897856:0@lo:1000: 00000040:00080000:0.0:1788636540.645185:0:7883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788636540.645212:0:7883:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000005af2c3d6 with version 1 00000004:00080000:1.0:1788636540.645238:0:7881:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000ed0da936 version 1 rpc_version 1 00000020:00100000:1.0:1788636540.645259:0:7881:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788636540.645267:0:7881:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b26a2d5e x1875521225898112/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636540.645283:0:7881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b26a2d5e pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7881:1875521225898112:0@lo:1000: 00000100:00100000:1.0:1788636540.645313:0:7881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636540.645332:0:7881:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f926a3d8 going to sleep for 11 seconds 00000100:00100000:1.0:1788636540.645345:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225898112 00000100:00100000:1.0:1788636540.645349:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225898112 00000100:00100000:1.0:1788636540.645386:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788636540.645394:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c5eea3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7881:x1875521225898112:12345-0@lo:1000: 00000040:00080000:0.0:1788636540.648640:0:7883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788636540.648745:0:7883:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788636540.648750:0:7883:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1788636540.653160:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1788636540.654448:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c5eea3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7881:x1875521225898112:12345-0@lo:1000: Request processed in 9049us (9127us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788636540.654462:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1788636540.654611:0:7881:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788636540.654617:0:7881:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788636540.654634:0:7881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b26a2d5e pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7881:1875521225898112:0@lo:1000: 00010000:00010000:0.0:1788636541.206382:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636541.589455:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636541.589483:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db17d9e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225898240:0@lo:41: 00000100:00100000:0.0:1788636541.589557:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636541.589713:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225898240 00000100:00100000:2.0:1788636541.589725:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225898240 00000100:00100000:2.0:1788636541.589784:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788636541.589792:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000705a2cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225898240:12345-0@lo:41: 00000004:00000024:2.0:1788636541.589869:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788636541.589927:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000705a2cc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225898240:12345-0@lo:41: Request processed in 136us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636541.589934:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788636541.589982:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db17d9e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225898240:0@lo:41: 00000020:00000080:3.0:1788636541.731108:0:7928:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd089964c0 20000000:00000080:3.0:1788636541.731130:0:7928:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf03a75b800 uarg=0000000000000000 20000000:01000000:3.0:1788636541.731176:0:7928:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788636541.731184:0:7928:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788636541.731190:0:7928:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788636541.731273:0:7928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788636541.731285:0:7928:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788636541.741894:0:7928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636541.742193:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788636541.742233:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788636541.742249:0:7928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788636541.742270:0:7928:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788636541.742289:0:7928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636541.742311:0:7928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c6ef95d0/0x5b741ef42e837dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837dcb expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636541.742318:0:7928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009221780e/0x5b741ef42e837ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837eb9 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636541.742347:0:7928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636541.742390:0:7928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009221780e/0x5b741ef42e837ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837eb9 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636541.742406:0:7928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009221780e/0x5b741ef42e837ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837eb9 expref: 17 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636541.742419:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009606e33 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1875521225898368:0@lo:104: 00000100:00100000:3.0:1788636541.742484:0:7928:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636541.742554:0:7928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c6ef95d0/0x5b741ef42e837dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837dcb expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636541.742562:0:7928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c6ef95d0/0x5b741ef42e837dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837dcb expref: 17 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636541.742571:0:7928:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d30eb44 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1875521225898496:0@lo:104: 00000100:00100000:3.0:1788636541.742588:0:7928:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fb48d598 going to sleep for 11 seconds 00000100:00100000:1.0:1788636541.742637:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788636541.742665:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636541.742689:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225898368 00000100:00100000:2.0:1788636541.742696:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225898496 00000100:00100000:1.0:1788636541.742696:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225898368 00000100:00100000:2.0:1788636541.742699:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225898496 00000100:00100000:1.0:1788636541.742736:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788636541.742744:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000371b35ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:7928:x1875521225898496:12345-0@lo:104: 00010000:00010000:1.0:1788636541.742759:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636541.742861:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636541.742866:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000371b35ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:7928:x1875521225898496:12345-0@lo:104: Request processed in 123us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636541.742873:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788636541.742893:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636541.742898:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e636c42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:7928:x1875521225898368:12345-0@lo:104: 00010000:00010000:1.0:1788636541.742905:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636541.742940:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788636541.742944:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e636c42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:7928:x1875521225898368:12345-0@lo:104: Request processed in 48us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636541.742950:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788636541.743038:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636541.743045:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743053:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000047717b18 already unused, calling callback (00000000e0381c25) 10000000:00010000:0.0:1788636541.743057:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743065:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636541.743072:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636541.743085:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636541.743126:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743133:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636541.743155:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743161:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: 0000000047717b18/0x5b741ef42e837dcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837dd2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743174:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636541.743176:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743182:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ddce6c1a already unused, calling callback (00000000e0381c25) 10000000:00010000:0.0:1788636541.743184:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743189:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636541.743194:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636541.743199:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636541.743210:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743216:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636541.743237:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743243:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: 00000000ddce6c1a/0x5b741ef42e837eb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837ec0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743257:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636541.743259:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636541.743261:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636541.743273:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225898624:0@lo:103: 00000100:00100000:0.0:1788636541.743305:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636541.743357:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e192c93a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225898752:0@lo:103: 00000100:00100000:0.0:1788636541.743382:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636541.743416:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225898624 00000100:00100000:0.0:1788636541.743421:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225898624 00010000:00010000:0.0:1788636541.743441:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c6ef95d0/0x5b741ef42e837dd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837dcb expref: 18 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636541.743458:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225898752 00000100:00100000:0.0:1788636541.743461:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225898752 00010000:00010000:0.0:1788636541.743470:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009221780e/0x5b741ef42e837ec0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837eb9 expref: 19 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636541.743482:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636541.743489:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f56fed4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3647:x1875521225898624:12345-0@lo:103: 00010000:00010000:0.0:1788636541.743500:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636541.743507:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c6ef95d0/0x5b741ef42e837dd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837dcb expref: 19 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743517:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c6ef95d0/0x5b741ef42e837dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837dcb expref: 19 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743543:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636541.743572:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f56fed4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3647:x1875521225898624:12345-0@lo:103: Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636541.743580:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636541.743593:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788636541.743599:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af30a428 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:3648:x1875521225898752:12345-0@lo:103: 00010000:00010000:0.0:1788636541.743606:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636541.743609:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009221780e/0x5b741ef42e837ec0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837eb9 expref: 18 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743616:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009221780e/0x5b741ef42e837ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837eb9 expref: 18 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743626:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743632:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743644:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743651:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743658:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743664:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743675:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000054244cb3 already unused, calling callback (00000000ea3c6fd1) 00010000:00010000:0.0:1788636541.743679:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743686:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743695:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636541.743703:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636541.743731:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af30a428 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:3648:x1875521225898752:12345-0@lo:103: Request processed in 133us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636541.743736:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788636541.743778:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e192c93a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225898752:0@lo:103: 00000100:00100000:0.0:1788636541.743834:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225898624:0@lo:103: 00010000:00010000:2.0:1788636541.743914:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636541.744227:0:7928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009221780e/0x5b741ef42e837ec0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837eb9 expref: 17 pid: 6516 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636541.744241:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009606e33 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1875521225898368:0@lo:104: 00010000:00010000:3.0:1788636541.744250:0:7928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c6ef95d0/0x5b741ef42e837dd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837dcb expref: 16 pid: 6513 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636541.744257:0:7928:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d30eb44 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7928:1875521225898496:0@lo:104: 00010000:00010000:3.0:1788636541.744511:0:7928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636541.744534:0:7928:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636541.744539:0:7928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636541.744545:0:7928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000054244cb3/0x5b741ef42e837f53 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636542.229103:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636543.253517:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636544.280018:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.302211:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636545.686602:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000055cc24a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225899264:0@lo:400: 00000100:00100000:3.0:1788636545.686686:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.686746:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788636545.686752:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d30eb44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225898880:0@lo:400: 00000100:00100000:3.0:1788636545.686782:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.686829:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008795e872 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225899392:0@lo:400: 00000100:00100000:3.0:1788636545.686854:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.686880:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009606e33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225899008:0@lo:400: 00000100:00100000:3.0:1788636545.686903:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.686920:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636545.686924:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008aea93dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225899136:0@lo:400: 00000100:00100000:3.0:1788636545.686945:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.686978:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225899264 00000100:00100000:3.0:1788636545.686986:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225899264 00000100:00100000:3.0:1788636545.687037:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225899008 00000100:00100000:3.0:1788636545.687040:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225899008 00000100:00100000:3.0:1788636545.687057:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636545.687074:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000057625ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225899264:12345-0@lo:400: 00000100:00100000:3.0:1788636545.687135:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000057625ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225899264:12345-0@lo:400: Request processed in 61us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636545.687143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636545.687159:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636545.687165:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2e68da9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225899008:12345-0@lo:400: 00000100:00100000:3.0:1788636545.687193:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2e68da9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225899008:12345-0@lo:400: Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636545.687199:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636545.687216:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225898880 00000100:00100000:3.0:1788636545.687220:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225898880 00000100:00100000:3.0:1788636545.687246:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788636545.687265:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003f88d12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:3648:x1875521225898880:12345-0@lo:400: 00000100:00100000:3.0:1788636545.687291:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003f88d12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:3648:x1875521225898880:12345-0@lo:400: Request processed in 27us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636545.687297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788636545.687322:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225899392 00000100:00100000:3.0:1788636545.687325:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225899392 00000100:00100000:3.0:1788636545.687344:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225899136 00000100:00100000:3.0:1788636545.687347:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225899136 00000100:00100000:3.0:1788636545.687357:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788636545.687362:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000350445d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225899392:12345-0@lo:400: 00000100:00100000:3.0:1788636545.687391:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000350445d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225899392:12345-0@lo:400: Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636545.687396:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788636545.687405:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788636545.687410:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f3bf6ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225899136:12345-0@lo:400: 00000100:00100000:3.0:1788636545.687438:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f3bf6ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225899136:12345-0@lo:400: Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636545.687444:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788636545.687480:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d30eb44 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225898880:0@lo:400: 00000100:00100000:3.0:1788636545.687491:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008795e872 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225899392:0@lo:400: 00010000:00080000:3.0:1788636545.687500:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000055cc24a9 x1875521225899264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636545.687509:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000055cc24a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225899264:0@lo:400: 00000100:00100000:3.0:1788636545.687532:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008aea93dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225899136:0@lo:400: 00010000:00080000:3.0:1788636545.687540:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000009606e33 x1875521225899008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636545.687548:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009606e33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225899008:0@lo:400: 00000100:00100000:3.0:1788636545.690281:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225899520:0@lo:41: 00000100:00100000:3.0:1788636545.690367:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636545.690502:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225899520 00000100:00100000:1.0:1788636545.690510:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225899520 00000100:00100000:1.0:1788636545.690564:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788636545.690572:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009606e33 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225899520:12345-0@lo:41: 00000004:00000024:1.0:1788636545.690605:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788636545.690652:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009606e33 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225899520:12345-0@lo:41: Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636545.690672:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636545.690756:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d16374b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225899520:0@lo:41: 00010000:00010000:1.0:1788636546.325056:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636546.709039:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636546.709076:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e192c93a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225899648:0@lo:41: 00000100:00100000:2.0:1788636546.709182:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636546.709328:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225899648 00000100:00100000:0.0:1788636546.709339:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225899648 00000100:00100000:0.0:1788636546.709403:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636546.709412:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d46b0122 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225899648:12345-0@lo:41: 00000004:00000024:0.0:1788636546.709459:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788636546.709524:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d46b0122 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225899648:12345-0@lo:41: Request processed in 112us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636546.709531:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788636546.709622:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e192c93a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225899648:0@lo:41: 10000000:01000000:1.0:1788636547.230979:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788636547.230988:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00f150000 from 1 10000000:01000000:1.0:1788636547.230993:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636547.231052:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: 0000000022bef06a/0x5b741ef42e837f5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636547.231068:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: 0000000022bef06a/0x5b741ef42e837f5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636547.231082:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: 0000000022bef06a/0x5b741ef42e837f5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636547.231115:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000258c1554 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225899776:0@lo:101: 00000100:00100000:1.0:1788636547.231226:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636547.231285:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb8aebe9 going to sleep for 11 seconds 00000100:00100000:1.0:1788636547.231310:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225899776 00000100:00100000:1.0:1788636547.231318:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225899776 00000100:00100000:1.0:1788636547.231383:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788636547.231394:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b89d431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225899776:12345-0@lo:101: 00010000:00010000:1.0:1788636547.231410:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636547.231428:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee3e54fa/0x5b741ef42e837f61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837f5a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636547.231457:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee3e54fa/0x5b741ef42e837f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837f5a expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636547.231470:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee3e54fa/0x5b741ef42e837f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f5a expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636547.231496:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee3e54fa, rc 0) 00000100:00100000:1.0:1788636547.231543:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b89d431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225899776:12345-0@lo:101: Request processed in 151us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636547.231551:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788636547.231608:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000258c1554 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225899776:0@lo:101: 00010000:00010000:1.0:1788636547.231625:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: 0000000022bef06a/0x5b741ef42e837f5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636547.231633:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: 0000000022bef06a/0x5b741ef42e837f5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636547.231703:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000258c1554 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225899904:0@lo:501: 00000100:00100000:1.0:1788636547.231729:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636547.231742:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bb8aebe9 going to sleep for 11 seconds 00000100:00100000:3.0:1788636547.238857:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225899904 00000100:00100000:3.0:1788636547.238881:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225899904 00000100:00100000:3.0:1788636547.238958:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788636547.238970:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2b90d43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225899904:12345-0@lo:501: 00000100:00100000:3.0:1788636547.239188:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2b90d43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225899904:12345-0@lo:501: Request processed in 220us (7457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636547.239197:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788636547.239288:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000258c1554 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225899904:0@lo:501: 00000100:00100000:3.0:1788636547.239373:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008aea93dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225900032:0@lo:503: 00000100:00100000:3.0:1788636547.239428:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636547.239462:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000293999e4 going to sleep for 11 seconds 00000100:00100000:3.0:1788636547.239476:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225900032 00000100:00100000:3.0:1788636547.239480:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225900032 00000100:00100000:3.0:1788636547.239505:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788636547.239511:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031b52aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225900032:12345-0@lo:503: 00000100:00100000:3.0:1788636547.239596:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031b52aad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225900032:12345-0@lo:503: Request processed in 86us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636547.239604:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788636547.239645:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008aea93dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225900032:0@lo:503: 00000100:00100000:0.0:1788636547.242144:0:8142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc1a1cf7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8142:1875521225900160:0@lo:502: 00000100:00100000:0.0:1788636547.242265:0:8142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636547.242328:0:8142:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df7185e7 going to sleep for 11 seconds 00000100:00100000:2.0:1788636547.242388:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225900160 00000100:00100000:2.0:1788636547.242398:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225900160 00000100:00100000:2.0:1788636547.242458:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788636547.242468:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a03b6ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:8142:x1875521225900160:12345-0@lo:502: 00000100:00100000:2.0:1788636547.242653:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a03b6ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:8142:x1875521225900160:12345-0@lo:502: Request processed in 186us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636547.242662:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788636547.242771:0:8142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc1a1cf7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8142:1875521225900160:0@lo:502: 00000020:01000000:0.0:1788636547.242847:0:8142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636547.242863:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636547.242865:0:8142:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788636547.242876:0:8142:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf00f150000 00000020:00000080:0.0:1788636547.242879:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788636547.242927:0:8142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8142:1875521225900288:0@lo:502: 00000100:00100000:0.0:1788636547.242961:0:8142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636547.242981:0:8142:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636547.243033:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225900288 00000100:00100000:2.0:1788636547.243038:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225900288 00000100:00100000:2.0:1788636547.243070:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788636547.243078:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:8142:x1875521225900288:12345-0@lo:502: 00000100:00100000:2.0:1788636547.243142:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:8142:x1875521225900288:12345-0@lo:502: Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636547.243154:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788636547.243231:0:8142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8142:1875521225900288:0@lo:502: 00000020:01000000:0.0:1788636547.243250:0:8142:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636547.243255:0:8142:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636547.243257:0:8142:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788636547.243261:0:8142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788636547.243439:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788636547.243473:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636547.243485:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990400/0x5b741ef42e837f5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636547.243499:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015990400/0x5b741ef42e837f5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636547.243512:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636547.243515:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00324c000 from 1 10000000:01000000:2.0:1788636547.243518:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636547.243550:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636547.243560:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636547.243570:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636547.243585:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225900416:0@lo:101: 00000100:00100000:2.0:1788636547.243617:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636547.243641:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636547.243683:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225900416 00000100:00100000:0.0:1788636547.243688:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225900416 00000100:00100000:0.0:1788636547.243718:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788636547.243726:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225900416:12345-0@lo:101: 00010000:00010000:0.0:1788636547.243735:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636547.243751:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e837f6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837f68 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636547.243780:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e837f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837f68 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636547.243794:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e837f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f68 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636547.243837:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7a00, rc 0) 00000100:00100000:0.0:1788636547.243884:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225900416:12345-0@lo:101: Request processed in 159us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636547.243891:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788636547.243924:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225900416:0@lo:101: 00010000:00010000:0.0:1788636547.243939:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636547.243949:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636547.244005:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225900544:0@lo:501: 00000100:00100000:0.0:1788636547.244032:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636547.244050:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636547.244062:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225900544 00000100:00100000:0.0:1788636547.244066:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225900544 00000100:00100000:0.0:1788636547.244089:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788636547.244097:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225900544:12345-0@lo:501: 00000100:00100000:0.0:1788636547.244236:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225900544:12345-0@lo:501: Request processed in 139us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636547.244243:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788636547.244280:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225900544:0@lo:501: 00000100:00100000:0.0:1788636547.244309:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225900672:0@lo:503: 00000100:00100000:0.0:1788636547.244346:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636547.244360:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636547.244371:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225900672 00000100:00100000:0.0:1788636547.244375:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225900672 00000100:00100000:0.0:1788636547.244395:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788636547.244410:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225900672:12345-0@lo:503: 00000100:00100000:0.0:1788636547.244493:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225900672:12345-0@lo:503: Request processed in 84us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636547.244500:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788636547.244542:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225900672:0@lo:503: 00000100:00100000:0.0:1788636547.244770:0:8143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8143:1875521225900800:0@lo:502: 00000100:00100000:0.0:1788636547.244837:0:8143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636547.244857:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225900800 00000100:00100000:0.0:1788636547.244861:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225900800 00000100:00100000:0.0:1788636547.244883:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788636547.244890:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:8143:x1875521225900800:12345-0@lo:502: 00000100:00100000:0.0:1788636547.244975:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:8143:x1875521225900800:12345-0@lo:502: Request processed in 86us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636547.244982:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788636547.245016:0:8143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636547.245028:0:8143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8143:1875521225900800:0@lo:502: 00000020:01000000:0.0:1788636547.245049:0:8143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636547.245059:0:8143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636547.245062:0:8143:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788636547.245069:0:8143:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf00324c000 00000020:00000080:0.0:1788636547.245071:0:8143:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788636547.245092:0:8143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8143:1875521225900928:0@lo:502: 00000100:00100000:0.0:1788636547.245124:0:8143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636547.245144:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225900928 00000100:00100000:0.0:1788636547.245148:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225900928 00000100:00100000:0.0:1788636547.245169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636547.245175:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:8143:x1875521225900928:12345-0@lo:502: 00000100:00100000:0.0:1788636547.245248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:8143:x1875521225900928:12345-0@lo:502: Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636547.245255:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636547.245282:0:8143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636547.245294:0:8143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8143:1875521225900928:0@lo:502: 00000020:01000000:0.0:1788636547.245310:0:8143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636547.245314:0:8143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636547.245316:0:8143:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788636547.245320:0:8143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788636547.245368:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788636547.245388:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788636547.245398:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636547.245409:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636547.349140:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636548.373978:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636549.411325:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636550.423113:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636550.810650:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225901184:0@lo:400: 00000100:00100000:1.0:1788636550.810747:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636550.810856:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788636550.810863:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225901056:0@lo:400: 00000100:00100000:1.0:1788636550.810900:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636550.810927:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225901568:0@lo:400: 00000100:00100000:1.0:1788636550.810956:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636550.810987:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225901312:0@lo:400: 00000100:00100000:1.0:1788636550.811012:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636550.811051:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636550.811057:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225901440:0@lo:400: 00000100:00100000:1.0:1788636550.811088:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636550.811124:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225901568 00000100:00100000:1.0:1788636550.811144:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225901568 00000100:00100000:1.0:1788636550.811200:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225901312 00000100:00100000:1.0:1788636550.811204:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225901312 00000100:00100000:1.0:1788636550.811232:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788636550.811243:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225901568:12345-0@lo:400: 00000100:00100000:1.0:1788636550.811310:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225901568:12345-0@lo:400: Request processed in 68us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636550.811319:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788636550.811341:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788636550.811347:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225901312:12345-0@lo:400: 00000100:00100000:1.0:1788636550.811380:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225901312:12345-0@lo:400: Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636550.811386:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788636550.811431:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225901312:0@lo:400: 00000100:00100000:1.0:1788636550.811464:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225901568:0@lo:400: 00000100:00100000:1.0:1788636550.811497:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225901056 00000100:00100000:1.0:1788636550.811501:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225901056 00000100:00100000:1.0:1788636550.811532:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636550.811538:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:3649:x1875521225901056:12345-0@lo:400: 00000100:00100000:1.0:1788636550.811576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:3649:x1875521225901056:12345-0@lo:400: Request processed in 38us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636550.811583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636550.811617:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225901056:0@lo:400: 00000100:00100000:3.0:1788636550.811859:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225901184 00000100:00100000:3.0:1788636550.811864:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225901184 00000100:00100000:3.0:1788636550.811896:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225901440 00000100:00100000:3.0:1788636550.811899:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225901440 00000100:00100000:3.0:1788636550.811914:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788636550.811920:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225901184:12345-0@lo:400: 00000100:00100000:3.0:1788636550.811966:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225901184:12345-0@lo:400: Request processed in 46us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636550.811973:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788636550.811987:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636550.811993:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225901440:12345-0@lo:400: 00000100:00100000:3.0:1788636550.812024:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225901440:12345-0@lo:400: Request processed in 31us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636550.812030:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788636550.812070:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf00f1ef100 x1875521225901440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636550.812092:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225901440:0@lo:400: 00010000:00080000:3.0:1788636550.812123:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf00f1eed80 x1875521225901184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636550.812142:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225901184:0@lo:400: 00000100:00100000:1.0:1788636550.819655:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636550.819698:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225901696:0@lo:41: 00000100:00100000:1.0:1788636550.819798:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636550.821993:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225901696 00000100:00100000:0.0:1788636550.822015:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225901696 00000100:00100000:0.0:1788636550.822108:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788636550.822121:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225901696:12345-0@lo:41: 00000004:00000024:0.0:1788636550.822190:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788636550.822312:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225901696:12345-0@lo:41: Request processed in 192us (2513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636550.822320:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788636550.822443:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225901696:0@lo:41: 00010000:00010000:3.0:1788636551.475145:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636551.831864:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636551.831891:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225901824:0@lo:41: 00000100:00100000:0.0:1788636551.831960:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636551.832076:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225901824 00000100:00100000:3.0:1788636551.832084:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225901824 00000100:00100000:3.0:1788636551.832143:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636551.832151:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225901824:12345-0@lo:41: 00000004:00000024:3.0:1788636551.832185:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788636551.832246:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225901824:12345-0@lo:41: Request processed in 95us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636551.832253:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636551.832297:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225901824:0@lo:41: 00010000:00010000:0.0:1788636552.539091:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636553.557927:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636554.580970:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788636554.663907:0:8429:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788636554.663916:0:8429:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788636554.663917:0:8429:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788636554.664065:0:8429:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cf00f1a3000 00000020:01000004:2.0:1788636554.664081:0:8429:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788636554.664100:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788636554.664115:0:8429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cf040b399c0) 00000020:00000080:2.0:1788636554.664130:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788636554.751569:0:8429:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788636554.752845:0:8429:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788636554.798907:0:8429:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788636554.800488:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788636554.800505:0:8429:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788636554.800521:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b741ef42e837f7d 00000020:01000004:2.0:1788636554.800530:0:8429:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788636554.800552:0:8429:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788636554.800556:0:8429:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788636554.800561:0:8429:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788636554.800566:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788636554.800584:0:8429:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cf040b38000) 00000020:00000080:2.0:1788636554.800596:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788636554.819466:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636554.819678:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788636554.819686:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788636554.824392:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788636554.824407:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788636554.834948:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788636554.835039:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788636554.841614:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636554.841856:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788636554.841864:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788636554.843589:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788636554.843600:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788636554.940014:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636554.940298:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788636554.940305:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788636554.948471:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788636554.948489:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788636554.953380:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788636554.953397:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788636554.962842:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636554.963067:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788636554.963074:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788636554.976569:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788636554.976595:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788636555.116963:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636555.117275:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788636555.117289:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788636555.129207:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788636555.129230:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788636555.135287:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788636555.135322:0:8429:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788636555.135330:0:8429:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788636555.203511:0:8429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788636555.203564:0:8429:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.126@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788636555.203569:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788636555.203571:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788636555.203572:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636555.203573:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636555.203574:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636555.203575:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636555.203577:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788636555.203578:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788636555.203579:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788636555.203581:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636555.203582:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788636555.203586:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788636555.203588:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788636555.203589:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788636555.203591:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636555.203592:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636555.203592:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636555.203594:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636555.203595:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788636555.203595:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788636555.203596:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788636555.203597:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636555.203598:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788636555.203625:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788636555.203643:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225901952:0@lo:253: 00000100:00100000:1.0:1788636555.203714:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.203864:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026ba53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.203954:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225901952 00000100:00100000:2.0:1788636555.203967:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225901952 00000100:00100000:2.0:1788636555.204061:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788636555.204071:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:8429:x1875521225901952:12345-0@lo:253: 20000000:01000000:2.0:1788636555.204111:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788636555.204115:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788636555.204120:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788636555.204124:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788636555.204447:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636555.204588:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788636555.204600:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788636555.204620:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788636555.204626:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788636555.204641:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788636555.204655:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788636555.204733:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788636555.204747:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.126@tcp 20000000:01000000:2.0:1788636555.204749:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788636555.204760:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788636555.204764:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788636555.204776:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788636555.204782:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.126@tcp (null) (null) 00000040:00080000:2.0:1788636555.204796:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788636555.204802:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788636555.204851:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788636555.204882:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788636555.204946:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788636555.204956:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.126@tcp 20000000:01000000:2.0:1788636555.204958:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788636555.204969:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788636555.204974:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788636555.204984:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788636555.204995:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.126@tcp (null) (null) 00000040:00080000:2.0:1788636555.205012:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788636555.205018:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788636555.205031:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788636555.205056:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788636555.205580:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788636555.205593:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.126@tcp 20000000:01000000:2.0:1788636555.205595:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.126@tcp (null) (null) (null) 00000040:00080000:2.0:1788636555.205608:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788636555.205613:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788636555.205624:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788636555.205628:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.126@tcp (null) (null) 00000040:00080000:2.0:1788636555.205638:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788636555.205642:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788636555.205653:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788636555.205669:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788636555.205681:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788636555.205683:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788636555.205687:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788636555.205729:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788636555.205731:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788636555.206361:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788636555.206591:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788636555.206609:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788636555.206624:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788636555.206633:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788636555.206635:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788636555.207239:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788636555.207319:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788636555.207342:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788636555.207504:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788636555.207521:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788636555.207533:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788636555.207542:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788636555.207544:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788636555.208688:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788636555.208719:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788636555.208734:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788636555.208974:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788636555.208991:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788636555.209007:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1788636555.209016:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788636555.209018:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788636555.209665:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788636555.209691:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788636555.209709:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788636555.209934:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788636555.209952:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788636555.209964:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1788636555.209977:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788636555.209997:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.210016:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf000030600/0x5b741ef42e837e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837e50 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.210024:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf000031800/0x5b741ef42e837ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837ec7 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.210052:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf000030000/0x5b741ef42e837f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837eff expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.210059:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf000031000/0x5b741ef42e837f22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f1b expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.210067:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015ece000/0x5b741ef42e837f4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f45 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.210176:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.210218:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015ece000/0x5b741ef42e837f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837f45 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.210234:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015ece000/0x5b741ef42e837f4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837f45 expref: 18 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.210249:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225902080:0@lo:104: 00000100:00100000:0.0:1788636555.210373:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636555.210474:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf000031000/0x5b741ef42e837f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837f1b expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.210483:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf000031000/0x5b741ef42e837f22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837f1b expref: 18 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.210493:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225902208:0@lo:104: 00000100:00100000:0.0:1788636555.210514:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636555.210593:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf000030000/0x5b741ef42e837f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837eff expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.210605:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf000030000/0x5b741ef42e837f06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837eff expref: 18 pid: 6514 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.210615:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225902336:0@lo:104: 00000100:00100000:0.0:1788636555.210638:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.210695:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225902080 00000100:00100000:1.0:1788636555.210703:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225902080 00000100:00100000:1.0:1788636555.210737:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225902208 00000100:00100000:1.0:1788636555.210745:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225902208 00000100:00100000:1.0:1788636555.210760:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788636555.210769:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6513:x1875521225902080:12345-0@lo:104: 00010000:00010000:1.0:1788636555.210783:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e837f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.210863:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636555.210869:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6513:x1875521225902080:12345-0@lo:104: Request processed in 102us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.210876:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788636555.210893:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636555.210899:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6513:x1875521225902208:12345-0@lo:104: 00010000:00010000:1.0:1788636555.210906:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf000031400/0x5b741ef42e837f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.210939:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788636555.210944:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6513:x1875521225902208:12345-0@lo:104: Request processed in 46us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.210949:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788636555.211041:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788636555.211048:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e837f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211055:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0013a1800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636555.211059:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e837f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211068:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e837f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636555.211198:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e837f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636555.211207:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636555.211248:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e837f45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211254:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788636555.211379:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788636555.211398:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e837f45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211406:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e837f45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f4c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211422:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636555.211425:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf000031400/0x5b741ef42e837f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211430:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000031400 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636555.211433:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf000031400/0x5b741ef42e837f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211455:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf000031400/0x5b741ef42e837f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636555.211460:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf000031400/0x5b741ef42e837f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636555.211466:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636555.211486:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf000031400/0x5b741ef42e837f1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211492:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636555.211504:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf000031400/0x5b741ef42e837f1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211510:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf000031400/0x5b741ef42e837f1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f22 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211520:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636555.211522:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636555.211524:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636555.211538:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225902592:0@lo:103: 00000100:00100000:3.0:1788636555.211581:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.211638:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225902592 00000100:00100000:3.0:1788636555.211643:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225902592 00010000:00010000:3.0:1788636555.211660:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf000031000/0x5b741ef42e837f22 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837f1b expref: 19 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.211680:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636555.211686:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3648:x1875521225902592:12345-0@lo:103: 00010000:00010000:3.0:1788636555.211702:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636555.211708:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf000031000/0x5b741ef42e837f22 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837f1b expref: 19 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211718:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf000031000/0x5b741ef42e837f22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837f1b expref: 19 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.211733:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636555.211757:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3648:x1875521225902592:12345-0@lo:103: Request processed in 71us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.211763:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636555.211802:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225902592:0@lo:103: 00010000:00010000:0.0:1788636555.211992:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf000031800/0x5b741ef42e837ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837ec7 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.212003:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf000031800/0x5b741ef42e837ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837ec7 expref: 18 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.212013:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225902720:0@lo:104: 00000100:00100000:0.0:1788636555.212046:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636555.212065:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf000030600/0x5b741ef42e837e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837e50 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.212073:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf000030600/0x5b741ef42e837e57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837e50 expref: 18 pid: 6516 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.212095:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225902848:0@lo:104: 00000100:00100000:0.0:1788636555.212114:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.212124:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040900300 going to sleep for 11 seconds 00000100:00100000:0.0:1788636555.212138:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225902080:0@lo:104: 00010000:00010000:0.0:1788636555.212146:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031000/0x5b741ef42e837f22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837f1b expref: 18 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.212155:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225902208:0@lo:104: 00010000:00010000:0.0:1788636555.212166:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636555.212284:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225902336 00000100:00100000:3.0:1788636555.212289:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225902336 00000100:00100000:3.0:1788636555.212308:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225902720 00000100:00100000:3.0:1788636555.212309:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225902720 00000100:00100000:3.0:1788636555.212316:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225902848 00000100:00100000:3.0:1788636555.212318:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225902848 00000100:00100000:3.0:1788636555.212328:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636555.212334:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:6513:x1875521225902336:12345-0@lo:104: 00010000:00010000:3.0:1788636555.212344:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e837eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212388:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636555.212394:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:6513:x1875521225902336:12345-0@lo:104: Request processed in 60us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.212400:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636555.212412:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788636555.212418:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6513:x1875521225902720:12345-0@lo:104: 00010000:00010000:3.0:1788636555.212432:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015ece600/0x5b741ef42e837ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212458:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788636555.212462:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6513:x1875521225902720:12345-0@lo:104: Request processed in 45us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.212467:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788636555.212478:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636555.212485:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6513:x1875521225902848:12345-0@lo:104: 00010000:00010000:3.0:1788636555.212492:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212515:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788636555.212520:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6513:x1875521225902848:12345-0@lo:104: Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.212526:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788636555.212538:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788636555.212542:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e837eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212548:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000030200 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636555.212551:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e837eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212559:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e837eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636555.212566:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e837eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636555.212578:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636555.212599:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e837eff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212606:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636555.212615:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e837eff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212621:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e837eff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f06 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212632:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788636555.212635:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015ece600/0x5b741ef42e837ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212641:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ece600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636555.212644:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ece600/0x5b741ef42e837ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212651:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015ece600/0x5b741ef42e837ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636555.212658:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ece600/0x5b741ef42e837ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636555.212663:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636555.212673:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015ece600/0x5b741ef42e837ec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.212679:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636555.212717:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788636555.212862:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225902336:0@lo:104: 00000100:00100000:0.0:1788636555.212870:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225902720:0@lo:104: 00000100:00100000:0.0:1788636555.212876:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1875521225902848:0@lo:104: 00010000:00010000:0.0:1788636555.212897:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.212957:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.212962:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.212969:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015991a00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636555.212972:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.212980:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636555.212986:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636555.212992:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636555.213006:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837e50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.213011:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636555.213235:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015ece600/0x5b741ef42e837ec7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213243:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015ece600/0x5b741ef42e837ec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837ece expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213254:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636555.213256:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636555.213258:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636555.213279:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225902976:0@lo:103: 00000100:00100000:3.0:1788636555.213312:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.213353:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225902976 00000100:00100000:3.0:1788636555.213357:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225902976 00010000:00010000:3.0:1788636555.213373:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf000030000/0x5b741ef42e837f06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837eff expref: 18 pid: 6514 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.213392:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788636555.213399:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:3649:x1875521225902976:12345-0@lo:103: 00010000:00010000:3.0:1788636555.213408:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636555.213412:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf000030000/0x5b741ef42e837f06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837eff expref: 18 pid: 6514 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213422:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf000030000/0x5b741ef42e837f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837eff expref: 18 pid: 6514 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213432:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000030000/0x5b741ef42e837f06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837eff expref: 18 pid: 6514 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213443:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636555.213467:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032407100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:3649:x1875521225902976:12345-0@lo:103: Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.213481:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788636555.213506:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225902976:0@lo:103: 00000100:00100000:3.0:1788636555.213519:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225903232:0@lo:103: 00000100:00100000:3.0:1788636555.213539:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.213556:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636555.213563:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225903104:0@lo:103: 00000100:00100000:3.0:1788636555.213590:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.213611:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225903232 00000100:00100000:3.0:1788636555.213614:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225903232 00010000:00010000:3.0:1788636555.213627:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf000030600/0x5b741ef42e837e57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837e50 expref: 17 pid: 6516 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.213639:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225903104 00000100:00100000:3.0:1788636555.213642:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225903104 00010000:00010000:3.0:1788636555.213650:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf000031800/0x5b741ef42e837ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837ec7 expref: 18 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.213660:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636555.213664:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:3647:x1875521225903232:12345-0@lo:103: 00010000:00010000:3.0:1788636555.213669:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636555.213673:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf000030600/0x5b741ef42e837e57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837e50 expref: 18 pid: 6516 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213681:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf000030600/0x5b741ef42e837e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837e50 expref: 18 pid: 6516 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213691:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000030600/0x5b741ef42e837e57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837e50 expref: 18 pid: 6516 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213711:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636555.213733:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:3647:x1875521225903232:12345-0@lo:103: Request processed in 68us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.213739:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636555.213750:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788636555.213755:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:3647:x1875521225903104:12345-0@lo:103: 00010000:00010000:3.0:1788636555.213762:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636555.213767:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf000031800/0x5b741ef42e837ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837ec7 expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213775:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf000031800/0x5b741ef42e837ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837ec7 expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213785:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031800/0x5b741ef42e837ece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837ec7 expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.213793:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636555.213826:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:3647:x1875521225903104:12345-0@lo:103: Request processed in 72us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.213833:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788636555.213862:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032406680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225903104:0@lo:103: 00000100:00100000:3.0:1788636555.213869:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225903232:0@lo:103: 00000100:00100000:1.0:1788636555.213983:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225902464:0@lo:103: 00000100:00100000:1.0:1788636555.214015:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.214234:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225902464 00000100:00100000:3.0:1788636555.214238:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225902464 00010000:00010000:3.0:1788636555.214252:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015ece000/0x5b741ef42e837f4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837f45 expref: 15 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.214387:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636555.214394:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:3646:x1875521225902464:12345-0@lo:103: 00010000:00010000:3.0:1788636555.214400:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636555.214404:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015ece000/0x5b741ef42e837f4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837f45 expref: 15 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214413:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015ece000/0x5b741ef42e837f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837f45 expref: 15 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214424:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ece000/0x5b741ef42e837f4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837f45 expref: 15 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214437:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214446:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214459:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214467:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214472:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214478:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214494:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636555.214499:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214508:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214528:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.214537:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636555.214569:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:3646:x1875521225902464:12345-0@lo:103: Request processed in 176us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.214576:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636555.214619:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225902464:0@lo:103: 00010000:00010000:1.0:1788636555.214717:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.214726:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.214733:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e837f8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788636555.214750:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1788636555.215419:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837e50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.215428:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837e50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837e57 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.215450:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.215451:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.215453:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.215460:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.215463:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636555.218722:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:8429:x1875521225901952:12345-0@lo:253: Request processed in 14644us (14998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.218736:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788636555.218876:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225901952:0@lo:253: 10000000:01000000:3.0:1788636555.218892:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788636555.218895:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788636555.218897:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788636555.218898:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636555.218900:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788636555.218901:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636555.218902:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636555.218903:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636555.218905:0:8429:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788636555.218907:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636555.218908:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788636555.218932:0:8429:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf00f1a3000 from lustre-OST0000 10000000:01000000:3.0:1788636555.218966:0:8429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788636555.218968:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788636555.218991:0:8429:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf040b3b380 local copy 10000000:01000000:3.0:1788636555.218996:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788636555.219046:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.219058:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.219068:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.219353:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225903360:0@lo:101: 00000100:00100000:3.0:1788636555.219394:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.219422:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.219481:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225903360 00000100:00100000:1.0:1788636555.219488:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225903360 00000100:00100000:1.0:1788636555.219533:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788636555.219541:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+13:8429:x1875521225903360:12345-0@lo:101: 00010000:00010000:1.0:1788636555.219553:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636555.219567:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015990200/0x5b741ef42e837f99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837f92 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.219588:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015990200/0x5b741ef42e837f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837f92 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.219600:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015990200/0x5b741ef42e837f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f92 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.219607:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015990200, rc 0) 00000100:00100000:1.0:1788636555.219646:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:8429:x1875521225903360:12345-0@lo:101: Request processed in 105us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.219652:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788636555.219747:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225903360:0@lo:101: 00010000:00010000:3.0:1788636555.219760:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.219769:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.219907:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225903488:0@lo:501: 00000100:00100000:3.0:1788636555.219932:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.219953:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636555.220003:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225903488 00000100:00100000:0.0:1788636555.220007:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225903488 00000100:00100000:0.0:1788636555.220045:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788636555.220052:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:8429:x1875521225903488:12345-0@lo:501: 00000100:00100000:0.0:1788636555.220144:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:8429:x1875521225903488:12345-0@lo:501: Request processed in 92us (210us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636555.220151:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788636555.220569:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225903488:0@lo:501: 10000000:01000000:3.0:1788636555.220582:0:8429:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788636555.220599:0:8429:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788636555.220604:0:8429:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.220620:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.220627:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.220651:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788636555.220675:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf00f1a3000 10000000:01000000:3.0:1788636555.220678:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788636555.220682:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788636555.220684:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788636555.220689:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788636555.220691:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788636555.220709:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.220717:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.220726:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.220737:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225903616:0@lo:101: 00000100:00100000:3.0:1788636555.220764:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.220787:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.220847:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225903616 00000100:00100000:1.0:1788636555.220852:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225903616 00000100:00100000:1.0:1788636555.220883:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788636555.220890:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:8429:x1875521225903616:12345-0@lo:101: 00010000:00010000:1.0:1788636555.220900:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636555.220917:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015990e00/0x5b741ef42e837fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837fa0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.220935:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015990e00/0x5b741ef42e837fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837fa0 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.220944:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015990e00/0x5b741ef42e837fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837fa0 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.220953:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015990e00, rc 0) 00000100:00100000:1.0:1788636555.220983:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225903616:12345-0@lo:101: Request processed in 94us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.220989:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788636555.221308:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225903616:0@lo:101: 00010000:00010000:3.0:1788636555.221320:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.221338:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.221396:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225903744:0@lo:501: 00000100:00100000:3.0:1788636555.221423:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.221453:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.221504:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225903744 00000100:00100000:2.0:1788636555.221509:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225903744 00000100:00100000:2.0:1788636555.221531:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788636555.221536:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225903744:12345-0@lo:501: 00000100:00100000:2.0:1788636555.221631:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225903744:12345-0@lo:501: Request processed in 94us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.221638:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788636555.221849:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225903744:0@lo:501: 00000100:00100000:3.0:1788636555.221876:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225903872:0@lo:503: 00000100:00100000:3.0:1788636555.221912:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.221933:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.222010:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225903872 00000100:00100000:2.0:1788636555.222014:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225903872 00000100:00100000:2.0:1788636555.222051:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788636555.222058:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225903872:12345-0@lo:503: 00010000:00010000:0.0:1788636555.222196:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636555.222204:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.222214:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153e400 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636555.222217:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.222226:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636555.222233:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636555.222238:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636555.222260:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.222273:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636555.222314:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.222321:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153e400/0x5b741ef42e837f92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b741ef42e837f99 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.222334:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.222336:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.222337:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636555.222345:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636555.222359:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225904000:0@lo:103: 00000100:00100000:2.0:1788636555.222381:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225903872:12345-0@lo:503: Request processed in 321us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.222388:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788636555.222400:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.222437:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225904000 00000100:00100000:0.0:1788636555.222442:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225904000 00000100:00100000:1.0:1788636555.222472:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225903872:0@lo:503: 00000100:00100000:0.0:1788636555.222488:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636555.222497:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:3649:x1875521225904000:12345-0@lo:103: 00010000:00010000:0.0:1788636555.222507:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:1.0:1788636555.222714:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788636555.222790:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904128:0@lo:502: 00000100:00100000:1.0:1788636555.222849:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.222873:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225904128 00000100:00100000:1.0:1788636555.222877:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225904128 00000100:00100000:1.0:1788636555.222898:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788636555.222904:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225904128:12345-0@lo:502: 00010000:00010000:0.0:1788636555.222953:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015990200/0x5b741ef42e837f99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b741ef42e837f92 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.222970:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636555.222989:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225904128:12345-0@lo:502: Request processed in 83us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.222997:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788636555.223013:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:3649:x1875521225904000:12345-0@lo:103: Request processed in 516us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.223021:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636555.223047:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ac44a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.223066:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904128:0@lo:502: 00000100:00100000:0.0:1788636555.223071:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225904000:0@lo:103: 00000040:00080000:1.0:1788636555.223600:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788636555.223626:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788636555.223650:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788636555.223664:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788636555.223675:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788636555.223684:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788636555.223707:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904256:0@lo:502: 00000100:00100000:1.0:1788636555.223746:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.223782:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ac44a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.223939:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225904256 00000100:00100000:2.0:1788636555.223944:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225904256 00000100:00100000:2.0:1788636555.223970:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788636555.223977:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:8429:x1875521225904256:12345-0@lo:502: 00000100:00100000:2.0:1788636555.224105:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:8429:x1875521225904256:12345-0@lo:502: Request processed in 127us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.224112:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788636555.224354:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904256:0@lo:502: 00000040:00080000:0.0:1788636555.224420:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788636555.224429:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788636555.225305:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788636555.225314:0:8453:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788636555.225321:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636555.225324:0:8453:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788636555.225337:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788636555.225359:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cef019d4d40) 00000020:00000080:2.0:1788636555.225380:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788636555.225386:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788636555.225457:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf00f1a3000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788636555.225465:0:8453:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788636555.225472:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b741ef42e837fb5 00010000:00010000:3.0:1788636555.242929:0:8453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788636555.243597:0:8453:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788636555.250915:0:8453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788636555.251618:0:8453:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788636555.259697:0:8453:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788636555.261260:0:8453:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788636555.273633:0:8453:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788636555.276028:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788636555.276051:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636555.276059:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636555.276061:0:8453:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788636555.276065:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636555.276069:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636555.276071:0:8453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788636555.276084:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788636555.276086:0:8453:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788636555.276115:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636555.276127:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636555.276128:0:8453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788636555.276141:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788636555.278918:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788636555.278968:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788636555.278984:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.278998:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636555.279007:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00f1a3000 from 1 10000000:01000000:1.0:1788636555.279010:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636555.279063:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.279071:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.279082:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636555.279104:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904384:0@lo:101: 00000100:00100000:1.0:1788636555.279181:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.279231:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08180 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.279265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225904384 00000100:00100000:1.0:1788636555.279282:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225904384 00000100:00100000:1.0:1788636555.279343:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788636555.279352:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:8429:x1875521225904384:12345-0@lo:101: 00010000:00010000:1.0:1788636555.279364:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636555.279376:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015990200/0x5b741ef42e837fc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837fbc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.279398:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015990200/0x5b741ef42e837fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837fbc expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.279409:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015990200/0x5b741ef42e837fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837fbc expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.279419:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015990200, rc 0) 00000100:00100000:1.0:1788636555.279452:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225904384:12345-0@lo:101: Request processed in 101us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.279458:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788636555.279504:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904384:0@lo:101: 00010000:00010000:1.0:1788636555.279695:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.279707:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636555.279794:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904512:0@lo:501: 00000100:00100000:1.0:1788636555.279859:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.279874:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08180 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.279890:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225904512 00000100:00100000:1.0:1788636555.279893:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225904512 00000100:00100000:1.0:1788636555.279938:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788636555.279945:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225904512:12345-0@lo:501: 00000100:00100000:1.0:1788636555.280058:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225904512:12345-0@lo:501: Request processed in 112us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.280064:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788636555.280098:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904512:0@lo:501: 00000100:00100000:1.0:1788636555.280124:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904640:0@lo:503: 00000100:00100000:1.0:1788636555.280781:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.280838:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08180 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.281427:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225904640 00000100:00100000:3.0:1788636555.281436:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225904640 00000100:00100000:3.0:1788636555.281469:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788636555.281481:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225904640:12345-0@lo:503: 00000100:00100000:3.0:1788636555.281601:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225904640:12345-0@lo:503: Request processed in 125us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.281608:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788636555.281858:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904640:0@lo:503: 00000040:00080000:1.0:1788636555.284717:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788636555.284835:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904768:0@lo:502: 00000100:00100000:1.0:1788636555.284911:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.284956:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571540 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.285098:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225904768 00000100:00100000:3.0:1788636555.285106:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225904768 00000100:00100000:3.0:1788636555.285167:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788636555.285177:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225904768:12345-0@lo:502: 00000100:00100000:3.0:1788636555.285418:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225904768:12345-0@lo:502: Request processed in 109us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.285428:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788636555.288422:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904768:0@lo:502: 00000040:00080000:1.0:1788636555.289894:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788636555.289941:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788636555.289985:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904896:0@lo:502: 00000100:00100000:1.0:1788636555.290094:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.291928:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.303656:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225904896 00000100:00100000:2.0:1788636555.303672:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225904896 00000100:00100000:2.0:1788636555.303744:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788636555.303754:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225904896:12345-0@lo:502: 00000100:00100000:2.0:1788636555.305018:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225904896:12345-0@lo:502: Request processed in 1259us (14918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.305045:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788636555.313702:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225904896:0@lo:502: 00000040:00080000:1.0:1788636555.314790:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788636555.314942:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788636555.317707:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636555.317722:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636555.317724:0:8457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788636555.317732:0:8457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf00f1a3000 00000020:00000080:2.0:1788636555.317735:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788636555.317746:0:8457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636555.317748:0:8457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636555.317749:0:8457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788636555.317752:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788636555.318000:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788636555.318040:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636555.318099:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.318143:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636555.318196:0:8429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788636555.318199:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf00f1a3000 10000000:01000000:1.0:1788636555.318202:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf00f1a3000 10000000:01000000:1.0:1788636555.318207:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636555.318213:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00f1a3000 from 1 10000000:01000000:1.0:1788636555.318216:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788636555.318256:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.318266:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.318276:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636555.318530:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225905024:0@lo:101: 00000100:00100000:1.0:1788636555.318597:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.318642:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.320762:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225905024 00000100:00100000:2.0:1788636555.320776:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225905024 00000100:00100000:2.0:1788636555.320866:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788636555.320877:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8429:x1875521225905024:12345-0@lo:101: 00010000:00010000:2.0:1788636555.320894:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636555.320915:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e837fd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e837fca expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.320960:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e837fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e837fca expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.320971:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e837fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837fca expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.320982:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015ecec00, rc 0) 00000100:00100000:2.0:1788636555.321080:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225905024:12345-0@lo:101: Request processed in 205us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.321087:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788636555.321246:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225905024:0@lo:101: 00010000:00010000:0.0:1788636555.321267:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.321277:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.321403:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225905152:0@lo:501: 00000100:00100000:0.0:1788636555.321438:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.321460:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0110d5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.321726:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225905152 00000100:00100000:2.0:1788636555.321731:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225905152 00000100:00100000:2.0:1788636555.321764:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788636555.321771:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225905152:12345-0@lo:501: 00000100:00100000:2.0:1788636555.321899:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225905152:12345-0@lo:501: Request processed in 128us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.321905:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788636555.321942:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225905152:0@lo:501: 00000100:00100000:2.0:1788636555.321976:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225905280:0@lo:503: 00000100:00100000:2.0:1788636555.322018:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636555.322048:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225905280 00000100:00100000:2.0:1788636555.322052:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225905280 00000100:00100000:2.0:1788636555.322067:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788636555.322073:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225905280:12345-0@lo:503: 00000100:00100000:2.0:1788636555.324686:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225905280:12345-0@lo:503: Request processed in 2605us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.324718:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788636555.324777:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf005af69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.324799:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225905280:0@lo:503: 00000040:00080000:2.0:1788636555.326477:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636555.326717:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225905408:0@lo:502: 00000100:00100000:2.0:1788636555.326787:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636555.326903:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aba2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636555.330451:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225905408 00000100:00100000:0.0:1788636555.330471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225905408 00000100:00100000:0.0:1788636555.331115:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788636555.331143:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225905408:12345-0@lo:502: 00000100:00100000:0.0:1788636555.331630:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225905408:12345-0@lo:502: Request processed in 493us (4840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.331639:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788636555.331747:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225905408:0@lo:502: 00000040:00080000:3.0:1788636555.332011:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788636555.332056:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788636555.332073:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788636555.332089:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788636555.332102:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788636555.332116:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788636555.332139:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788636555.332155:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788636555.332166:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788636555.332177:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788636555.332189:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788636555.332215:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788636555.332227:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788636555.332237:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788636555.332248:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788636555.332259:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788636555.332274:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788636555.332314:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788636555.332327:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788636555.332349:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788636555.332363:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788636555.332374:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788636555.332385:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788636555.332395:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788636555.332406:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788636555.332420:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788636555.332435:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788636555.332445:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788636555.332455:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788636555.332466:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788636555.332477:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788636555.332490:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788636555.332504:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788636555.332537:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788636555.332550:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788636555.332563:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788636555.332577:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1788636555.332614:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225905536:0@lo:502: 00000100:00100000:3.0:1788636555.332670:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.338105:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026932b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.345013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225905536 00000100:00100000:2.0:1788636555.345039:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225905536 00000100:00100000:2.0:1788636555.345103:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788636555.345114:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225905536:12345-0@lo:502: 00000100:00100000:2.0:1788636555.345408:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225905536:12345-0@lo:502: Request processed in 296us (12738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.345417:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788636555.349434:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225905536:0@lo:502: 00000040:00080000:3.0:1788636555.350119:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788636555.350751:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788636555.367654:0:8458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788636555.367673:0:8458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cf03a6099c0) 00000020:00000080:1.0:1788636555.367700:0:8458:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788636555.367846:0:8458:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf00f1a3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788636555.367850:0:8458:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf00f1a3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788636555.367853:0:8458:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00f1a3000 3 00010000:00080000:1.0:1788636555.367882:0:8458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef02083000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.126@tcp at head 00010000:00010000:1.0:1788636555.377844:0:8458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788636555.378102:0:8458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788636555.378146:0:8458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788636555.378158:0:8458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5b741ef42e837fdf 00000100:00080000:1.0:1788636555.378168:0:8458:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636555.378174:0:8458:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cef02083000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636555.378211:0:8458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf00f1ee680 x1875521225905664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636555.378240:0:8458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788636555.379673:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521225905664:0@lo:38: 00000100:00100000:3.0:1788636555.379743:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.379831:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225905664 00000100:00100000:3.0:1788636555.379840:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225905664 00000100:00100000:3.0:1788636555.379871:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636555.379878:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521225905664:12345-0@lo:38: 00010000:00080000:3.0:1788636555.379903:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1788636555.379936:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5b741ef42e837fe6 00000004:00100000:3.0:1788636555.379951:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788636555.379983:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9cf03a604000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636555.380039:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875521225905664:12345-0@lo:38: Request processed in 150us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.380047:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788636555.380089:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf00f1ee680 x1875521225905664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636555.380100:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788636555.380107:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788636555.380115:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788636555.380120:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788636555.380122:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788636555.380129:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521225905664:0@lo:38: 00000020:01000004:1.0:1788636555.389917:0:8458:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788636555.389939:0:8458:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9cf03a608000) 00000020:00000080:1.0:1788636555.389971:0:8458:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788636555.390071:0:8458:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf00f1a3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788636555.390075:0:8458:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf00f1a3000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788636555.390078:0:8458:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00f1a3000 3 00010000:00080000:1.0:1788636555.390118:0:8458:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef02080000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.126@tcp at head 00000100:00100000:0.0:1788636555.393752:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636555.393778:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225905792:0@lo:400: 00000100:00100000:0.0:1788636555.393880:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.393941:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225905792 00000100:00100000:0.0:1788636555.393950:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225905792 00000100:00100000:0.0:1788636555.394003:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788636555.394011:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225905792:12345-0@lo:400: 00000100:00100000:0.0:1788636555.394081:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225905792:12345-0@lo:400: Request processed in 70us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.394102:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788636555.394164:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cef019b2d80 x1875521225905792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636555.394179:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225905792:0@lo:400: 00000100:00100000:0.0:1788636555.394224:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225905920:0@lo:400: 00000100:00100000:0.0:1788636555.394252:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.395391:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225905920 00000100:00100000:0.0:1788636555.395401:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225905920 00000100:00100000:0.0:1788636555.395445:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788636555.395453:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225905920:12345-0@lo:400: 00000100:00100000:0.0:1788636555.395598:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225905920:12345-0@lo:400: Request processed in 145us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.395606:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788636555.395656:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225905920:0@lo:400: 00000100:00100000:0.0:1788636555.395700:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225906048:0@lo:400: 00000100:00100000:0.0:1788636555.395729:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.395758:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225906048 00000100:00100000:0.0:1788636555.395761:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225906048 00000100:00100000:0.0:1788636555.395784:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788636555.395791:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225906048:12345-0@lo:400: 00000100:00100000:0.0:1788636555.395836:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225906048:12345-0@lo:400: Request processed in 45us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.395843:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788636555.395870:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cef019b2d80 x1875521225906048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636555.395894:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225906048:0@lo:400: 00000100:00100000:0.0:1788636555.395926:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225906176:0@lo:400: 00000100:00100000:0.0:1788636555.395952:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.395979:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225906176 00000100:00100000:0.0:1788636555.395982:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225906176 00000100:00100000:0.0:1788636555.396005:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788636555.396012:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225906176:12345-0@lo:400: 00000100:00100000:0.0:1788636555.396055:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225906176:12345-0@lo:400: Request processed in 43us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.396061:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788636555.396087:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225906176:0@lo:400: 00010000:00010000:1.0:1788636555.405106:0:8458:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1788636555.405948:0:8458:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788636555.406008:0:8458:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788636555.406022:0:8458:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5b741ef42e837ff4 00000100:00080000:0.0:1788636555.406042:0:8458:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788636555.406049:0:8458:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9cef02080000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636555.406085:0:8458:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef019b2d80 x1875521225906304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636555.406106:0:8458:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788636555.410549:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875521225906304:0@lo:38: 00000100:00100000:3.0:1788636555.410634:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.410803:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225906304 00000100:00100000:0.0:1788636555.410833:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225906304 00000100:00100000:0.0:1788636555.410875:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636555.410884:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521225906304:12345-0@lo:38: 00010000:00080000:0.0:1788636555.410915:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1788636555.410971:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5b741ef42e837ffb 00000004:00100000:0.0:1788636555.410990:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788636555.411023:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9cf0268db800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636555.411086:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875521225906304:12345-0@lo:38: Request processed in 201us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.411093:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788636555.411953:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cef019b2d80 x1875521225906304/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636555.411978:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788636555.411987:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788636555.411995:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788636555.412000:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788636555.412003:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef02080000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788636555.412009:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875521225906304:0@lo:38: 00000040:00080000:1.0:1788636555.413749:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788636555.413930:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788636555.413958:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788636555.413981:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.413993:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788636555.414047:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788636555.414049:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788636555.414050:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636555.414051:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636555.414053:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636555.414054:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636555.414056:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636555.414058:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788636555.414059:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788636555.414061:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636555.414062:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788636555.414066:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788636555.414069:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788636555.414070:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788636555.414071:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636555.414072:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636555.414073:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636555.414075:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636555.414080:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636555.414081:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788636555.414082:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788636555.414083:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636555.414083:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788636555.414109:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788636555.414139:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225906432:0@lo:253: 00000100:00100000:3.0:1788636555.414207:0:8429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.414243:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.414447:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225906432 00000100:00100000:2.0:1788636555.414455:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225906432 00000100:00100000:2.0:1788636555.414502:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788636555.414616:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225906432:12345-0@lo:253: 20000000:01000000:2.0:1788636555.414646:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788636555.414660:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788636555.431699:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788636555.431718:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788636555.431841:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788636555.431846:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788636555.431869:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.431888:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf000031a00/0x5b741ef42e837ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837ef1 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.431896:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e837f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f0d expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.431904:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.431957:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e837f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837f0d expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.431969:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e837f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837f0d expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636555.431985:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1eed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225906560:0@lo:104: 00000100:00100000:1.0:1788636555.432061:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636555.432105:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf000031a00/0x5b741ef42e837ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837ef1 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.432114:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf000031a00/0x5b741ef42e837ef8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837ef1 expref: 16 pid: 6516 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.432249:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788636555.432266:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225906560 00000100:00100000:3.0:1788636555.432274:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225906560 00000100:00100000:3.0:1788636555.432327:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636555.432335:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a76e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6537:x1875521225906560:12345-0@lo:104: 00010000:00010000:3.0:1788636555.432348:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf00153fa00/0x5b741ef42e837f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.432391:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636555.432396:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a76e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6537:x1875521225906560:12345-0@lo:104: Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.432404:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636555.432479:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:8429:x1875521225906432:12345-0@lo:253: Request processed in 17967us (18270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.432489:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788636555.432623:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8429:1875521225906432:0@lo:253: 10000000:01000000:3.0:1788636555.432638:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788636555.432642:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788636555.432643:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788636555.432645:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636555.432646:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636555.432647:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636555.432649:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636555.432650:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636555.432658:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788636555.432659:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788636555.432661:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636555.432662:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788636555.432676:0:8429:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788636555.433228:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636555.433236:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153fa00/0x5b741ef42e837f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.433245:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153fa00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636555.433249:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153fa00/0x5b741ef42e837f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.433258:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153fa00/0x5b741ef42e837f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636555.433266:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153fa00/0x5b741ef42e837f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636555.433272:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636555.433319:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf00153fa00/0x5b741ef42e837f0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.433327:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636555.433356:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153fa00/0x5b741ef42e837f0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.433362:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153fa00/0x5b741ef42e837f0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f14 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.433376:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.433385:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.433387:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636555.433390:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225906816:0@lo:103: 00000100:00100000:2.0:1788636555.433438:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.433658:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225906688:0@lo:104: 00000100:00100000:1.0:1788636555.433686:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.433712:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0094966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.433726:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1eed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225906560:0@lo:104: 00000100:00100000:2.0:1788636555.433748:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225906688 00000100:00100000:2.0:1788636555.433770:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225906688 00000100:00100000:0.0:1788636555.433776:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225906816 00000100:00100000:0.0:1788636555.433782:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225906816 00010000:00010000:0.0:1788636555.433804:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e837f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837f0d expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636555.433851:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636555.433869:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6537:x1875521225906688:12345-0@lo:104: 00010000:00010000:2.0:1788636555.433880:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e837ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.433930:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636555.433936:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6537:x1875521225906688:12345-0@lo:104: Request processed in 78us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.433944:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636555.433979:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225906688:0@lo:104: 00010000:00010000:2.0:1788636555.434000:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.434001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788636555.434011:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040991500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:3649:x1875521225906816:12345-0@lo:103: 00010000:00010000:0.0:1788636555.434022:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636555.434038:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e837f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837f0d expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.434050:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e837f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837f0d expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.434064:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e837f14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837f0d expref: 16 pid: 6513 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.434075:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636555.434114:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040991500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:3649:x1875521225906816:12345-0@lo:103: Request processed in 105us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.434130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:0.0:1788636555.434147:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636555.434153:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e837ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.434160:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ece800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636555.434163:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e837ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.434179:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e837ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636555.434185:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e837ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636555.434191:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636555.434213:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e837ef1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.434220:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636555.434234:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e837ef1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.434242:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e837ef1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837ef8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.434254:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.434255:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636555.434257:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636555.434270:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225906944:0@lo:103: 00000100:00100000:2.0:1788636555.434402:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225906816:0@lo:103: 00000100:00100000:0.0:1788636555.434781:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636555.434873:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225906944 00000100:00100000:2.0:1788636555.434879:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225906944 00010000:00010000:2.0:1788636555.434900:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf000031a00/0x5b741ef42e837ef8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837ef1 expref: 15 pid: 6516 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636555.434927:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636555.434932:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:3646:x1875521225906944:12345-0@lo:103: 00010000:00010000:2.0:1788636555.434939:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636555.434942:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf000031a00/0x5b741ef42e837ef8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837ef1 expref: 15 pid: 6516 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.434949:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf000031a00/0x5b741ef42e837ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837ef1 expref: 15 pid: 6516 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.434965:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031a00/0x5b741ef42e837ef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837ef1 expref: 15 pid: 6516 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.434974:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.434980:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788636555.434990:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004664106s 00010000:00010000:2.0:1788636555.434993:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.434998:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.435002:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.435006:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.435010:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636555.435012:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.435017:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.435038:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.435057:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.435059:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636555.435068:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.435076:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838002 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636555.435099:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:3646:x1875521225906944:12345-0@lo:103: Request processed in 166us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.435107:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636555.435143:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225906944:0@lo:103: 00080000:10000000:3.0:1788636555.441570:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788636555.441780:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788636555.442092:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788636555.442262:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788636555.442500:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788636555.442733:0:8429:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788636555.445685:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788636555.465074:0:8429:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788636555.465084:0:8429:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788636555.465121:0:8429:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788636555.465230:0:8429:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788636555.465250:0:8429:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788636555.465343:0:8429:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788636555.466450:0:8429:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636555.466645:0:8429:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 10000000:01000000:2.0:1788636555.585934:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788636555.585942:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00f150000 from 30 10000000:01000000:2.0:1788636555.585947:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788636555.587586:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.587607:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.587619:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636555.587646:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907072:0@lo:101: 00000100:00100000:2.0:1788636555.587718:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636555.587773:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aa2db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.588421:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225907072 00000100:00100000:1.0:1788636555.588431:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225907072 00000100:00100000:1.0:1788636555.588505:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788636555.588516:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:6519:x1875521225907072:12345-0@lo:101: 00010000:00010000:1.0:1788636555.588531:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636555.588544:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838009 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.588571:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838009 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.588580:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838009 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.588588:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015990c00, rc 0) 00000100:00100000:1.0:1788636555.588644:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225907072:12345-0@lo:101: Request processed in 130us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.588650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788636555.588708:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907072:0@lo:101: 00010000:00010000:1.0:1788636555.588727:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.588736:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636555.588802:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907200:0@lo:501: 00000100:00100000:1.0:1788636555.588853:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.588876:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0094966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.588888:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225907200 00000100:00100000:1.0:1788636555.588891:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225907200 00000100:00100000:1.0:1788636555.588912:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788636555.588924:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225907200:12345-0@lo:501: 00000100:00100000:1.0:1788636555.591946:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225907200:12345-0@lo:501: Request processed in 3014us (3083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.591958:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788636555.595787:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907200:0@lo:501: 00000100:00100000:1.0:1788636555.595888:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907328:0@lo:503: 00000100:00100000:1.0:1788636555.595959:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.601300:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0094966c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.607164:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225907328 00000100:00100000:3.0:1788636555.607186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225907328 00000100:00100000:3.0:1788636555.607482:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788636555.607495:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225907328:12345-0@lo:503: 00000100:00100000:3.0:1788636555.607670:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225907328:12345-0@lo:503: Request processed in 177us (11710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.607677:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788636555.618542:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907328:0@lo:503: 00010000:00010000:1.0:1788636555.639925:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636555.655128:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8469:1875521225907456:0@lo:502: 00000100:00100000:0.0:1788636555.655445:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.655504:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0110d5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.656334:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225907456 00000100:00100000:2.0:1788636555.656493:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225907456 00000100:00100000:2.0:1788636555.656564:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788636555.656578:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8469:x1875521225907456:12345-0@lo:502: 00000100:00100000:2.0:1788636555.656900:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8469:x1875521225907456:12345-0@lo:502: Request processed in 324us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.656916:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788636555.658337:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8469:1875521225907456:0@lo:502: 00000100:00100000:0.0:1788636555.659632:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8469:1875521225907584:0@lo:502: 00000100:00100000:0.0:1788636555.660044:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.660100:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0110d5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636555.668074:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225907584 00000100:00100000:2.0:1788636555.668089:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225907584 00000100:00100000:2.0:1788636555.668525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788636555.668540:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8469:x1875521225907584:12345-0@lo:502: 00000100:00100000:2.0:1788636555.669080:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:8469:x1875521225907584:12345-0@lo:502: Request processed in 542us (9034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.669089:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788636555.673490:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8469:1875521225907584:0@lo:502: 00000040:00080000:3.0:1788636555.673537:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788636555.675517:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788636555.675566:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788636555.675579:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.675594:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636555.675605:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788636555.675608:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf00f150000 from 5 10000000:01000000:1.0:1788636555.675611:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788636555.675658:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.675666:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.675677:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636555.675713:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907712:0@lo:101: 00000100:00100000:1.0:1788636555.675789:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.675909:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026acbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.676729:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225907712 00000100:00100000:3.0:1788636555.676740:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225907712 00000100:00100000:3.0:1788636555.683535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788636555.683588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225907712:12345-0@lo:101: 00010000:00010000:3.0:1788636555.683613:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636555.683644:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e83801e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838017 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.683681:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e83801e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838017 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.683696:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e83801e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838017 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.683707:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153fa00, rc 0) 00000100:00100000:3.0:1788636555.683930:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225907712:12345-0@lo:101: Request processed in 368us (8140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.688057:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907712:0@lo:101: 00010000:00010000:1.0:1788636555.688090:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636555.688104:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636555.688191:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907840:0@lo:256: 00000100:00100000:1.0:1788636555.688268:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.688308:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026acbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.688336:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225907840 00000100:00100000:1.0:1788636555.688341:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225907840 00000100:00100000:3.0:1788636555.697537:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788636555.703335:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788636555.703363:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225907840:12345-0@lo:256: 20000000:01000000:1.0:1788636555.703399:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788636555.703415:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788636555.703418:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788636555.703572:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225907840:12345-0@lo:256: Request processed in 222us (15303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.709999:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907840:0@lo:256: 00000100:00100000:1.0:1788636555.710361:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 10000000:01000000:0.0:1788636555.710480:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788636555.710492:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.710505:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636555.710517:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788636555.710520:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788636555.710523:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788636555.710569:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.710577:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.710588:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.710611:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907968:0@lo:101: 00000100:00100000:0.0:1788636555.710682:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.711078:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225907968 00000100:00100000:3.0:1788636555.711087:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225907968 00000100:00100000:3.0:1788636555.711349:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788636555.711361:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225907968:12345-0@lo:101: 00010000:00010000:3.0:1788636555.711377:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636555.711396:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83802c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838025 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.711430:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83802c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838025 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.711441:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83802c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838025 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.711468:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e400, rc 0) 00000100:00100000:3.0:1788636555.711513:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225907968:12345-0@lo:101: Request processed in 155us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.711520:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788636555.712774:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0110d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636555.712840:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225907968:0@lo:101: 00010000:00010000:0.0:1788636555.712863:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.712885:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.712971:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225908096:0@lo:501: 00000100:00100000:0.0:1788636555.713040:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.713080:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0110d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636555.713104:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225908096 00000100:00100000:0.0:1788636555.713110:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225908096 00000100:00100000:0.0:1788636555.713169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788636555.713181:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225908096:12345-0@lo:501: 00000100:00100000:0.0:1788636555.713498:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225908096:12345-0@lo:501: Request processed in 319us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.713506:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788636555.713551:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225908096:0@lo:501: 00000100:00100000:0.0:1788636555.713583:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225908224:0@lo:503: 00000100:00100000:0.0:1788636555.713630:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.713646:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0110d50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636555.713658:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225908224 00000100:00100000:0.0:1788636555.713661:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225908224 00000100:00100000:0.0:1788636555.713685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788636555.713691:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225908224:12345-0@lo:503: 00000100:00100000:0.0:1788636555.713765:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225908224:12345-0@lo:503: Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.713771:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788636555.713840:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225908224:0@lo:503: 00000100:00100000:3.0:1788636555.715371:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8475:1875521225908352:0@lo:502: 00000100:00100000:3.0:1788636555.715441:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.715484:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aba2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.715539:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225908352 00000100:00100000:1.0:1788636555.715546:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225908352 00000100:00100000:1.0:1788636555.715596:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788636555.715607:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:8475:x1875521225908352:12345-0@lo:502: 00000100:00100000:1.0:1788636555.715835:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:8475:x1875521225908352:12345-0@lo:502: Request processed in 230us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.715843:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788636555.724959:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8475:1875521225908352:0@lo:502: 00000020:01000000:2.0:1788636555.726211:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788636555.726223:0:8475:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788636555.726236:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636555.726239:0:8475:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788636555.726247:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788636555.726251:0:8475:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:01000000:2.0:1788636555.726282:0:8475:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788636555.726286:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788636555.726304:0:8475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9cef019d19c0) 00000020:00000080:2.0:1788636555.726331:0:8475:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788636555.726337:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788636555.726447:0:8475:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788636555.726455:0:8475:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788636555.726462:0:8475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e83803a 00010000:00080000:2.0:1788636555.726495:0:8475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf032425000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.126@tcp at head 00010000:00010000:3.0:1788636555.726761:0:8475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788636555.739384:0:8475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788636555.739411:0:8475:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788636555.739627:0:8475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636555.745525:0:8475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636555.745878:0:8475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788636555.746211:0:8475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788636555.746698:0:8477:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636555.746714:0:8477:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788636555.756091:0:8475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788636555.756110:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788636555.761879:0:8475:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788636555.761911:0:8475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e838041 00000100:00080000:1.0:1788636555.761923:0:8475:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636555.761930:0:8475:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9cf032425000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636555.761969:0:8475:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf00f1ed500 x1875521225908480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636555.762001:0:8475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788636555.762117:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788636555.763910:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521225908480:0@lo:8: 00000100:00100000:0.0:1788636555.763990:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788636555.764215:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636555.764228:0:8475:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788636555.764239:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636555.764245:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636555.764247:0:8475:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788636555.764251:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788636555.764253:0:8475:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788636555.764297:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8475:1875521225908608:0@lo:502: 00000100:00100000:1.0:1788636555.764358:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.764593:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a620600 going to sleep for 11 seconds 00000100:00100000:0.0:1788636555.764697:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225908608 00000100:00100000:0.0:1788636555.765016:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225908608 00000100:00100000:0.0:1788636555.765078:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788636555.765088:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:8475:x1875521225908608:12345-0@lo:502: 00000100:00100000:2.0:1788636555.765493:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225908480 00000100:00100000:2.0:1788636555.765500:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225908480 00000100:00100000:2.0:1788636555.765533:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636555.765540:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521225908480:12345-0@lo:8: 00010000:00080000:2.0:1788636555.765567:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:2.0:1788636555.765618:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e838048 00002000:00100000:2.0:1788636555.765669:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9cf03fc1c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788636555.765674:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1788636555.765678:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788636555.766092:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:8475:x1875521225908608:12345-0@lo:502: Request processed in 1004us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.766101:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788636555.766468:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8475:1875521225908608:0@lo:502: 00002000:00100000:2.0:1788636555.766570:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788636555.766794:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788636555.766846:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc18000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636555.766903:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875521225908480:12345-0@lo:8: Request processed in 1363us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.766911:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788636555.767932:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f1ed500 x1875521225908480/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636555.767945:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788636555.767954:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788636555.767963:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788636555.767969:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788636555.767972:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032425000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788636555.767990:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788636555.767996:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521225908480:0@lo:8: 00000100:00100000:0.0:1788636555.768171:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8478:1875521225908736:0@lo:700: 00000100:00100000:0.0:1788636555.768481:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.768517:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0061b06c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788636555.768532:0:8477:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788636555.768616:0:8477:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 224579809085ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788636555.768624:0:8477:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788636555.768708:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225908736 00000100:00100000:3.0:1788636555.768715:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225908736 00000100:00100000:3.0:1788636555.768776:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636555.768786:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8478:x1875521225908736:12345-0@lo:700: 00000100:00100000:3.0:1788636555.768877:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1875521225908864:0@lo:700: 00000100:00100000:3.0:1788636555.768907:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.768932:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aba29c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788636555.769068:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:0.0:1788636555.769920:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636555.769933:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636555.769935:0:8475:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788636555.769947:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:0.0:1788636555.770028:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788636555.770050:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788636555.770061:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.770073:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636555.770082:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788636555.770086:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00324c000 from 30 10000000:01000000:0.0:1788636555.770088:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788636555.770120:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.770139:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.770148:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.770167:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225908992:0@lo:101: 00000100:00100000:0.0:1788636555.770216:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.770257:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0061b0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.776142:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225908992 00000100:00100000:3.0:1788636555.776159:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225908992 00000100:00100000:3.0:1788636555.776235:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788636555.776247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225908992:12345-0@lo:101: 00010000:00010000:3.0:1788636555.776266:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636555.776287:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83804f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.776319:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83804f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.776332:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83804f expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.776341:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153fc00, rc 0) 00000100:00100000:3.0:1788636555.776421:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225908992:12345-0@lo:101: Request processed in 176us (6204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.776427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788636555.776494:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225908992:0@lo:101: 00010000:00010000:3.0:1788636555.776514:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.776523:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.776602:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225909120:0@lo:501: 00000100:00100000:3.0:1788636555.776634:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.776662:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a625cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.776690:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225909120 00000100:00100000:3.0:1788636555.776694:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225909120 00000100:00100000:3.0:1788636555.776731:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788636555.776738:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225909120:12345-0@lo:501: 00000100:00100000:3.0:1788636555.776881:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225909120:12345-0@lo:501: Request processed in 143us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.776888:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788636555.776916:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225909120:0@lo:501: 00000100:00100000:3.0:1788636555.776942:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225909248:0@lo:503: 00000100:00100000:3.0:1788636555.776983:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.776996:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a625cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.777008:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225909248 00000100:00100000:3.0:1788636555.777012:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225909248 00000100:00100000:3.0:1788636555.777048:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788636555.777054:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225909248:12345-0@lo:503: 00000100:00100000:3.0:1788636555.777129:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225909248:12345-0@lo:503: Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.777136:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788636555.777173:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225909248:0@lo:503: 00000100:00100000:1.0:1788636555.779797:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225908864 00000100:00100000:1.0:1788636555.783438:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225908864 00000100:00100000:1.0:1788636555.783544:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636555.783558:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1875521225908864:12345-0@lo:700: 00000100:00080000:3.0:1788636555.784629:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788636555.789872:0:7453:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:1.0:1788636555.790724:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788636555.793956:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8480:1875521225909376:0@lo:502: 00000100:00100000:2.0:1788636555.794073:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636555.794174:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aa2d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.802625:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1875521225908864:12345-0@lo:700: Request processed in 19061us (33707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.802642:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788636555.802703:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b5180 x1875521225908864/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788636571 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636555.802720:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b5180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1875521225908864:0@lo:700: 40000000:02000000:1.0:1788636555.802736:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:3.0:1788636555.805673:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225909376 00000100:00100000:3.0:1788636555.805691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225909376 00000100:00100000:3.0:1788636555.805754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788636555.805765:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:8480:x1875521225909376:12345-0@lo:502: 00000100:00100000:3.0:1788636555.805963:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:8480:x1875521225909376:12345-0@lo:502: Request processed in 200us (11891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.805981:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788636555.806345:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8480:1875521225909376:0@lo:502: 00000100:00100000:3.0:1788636555.806419:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8480:1875521225909504:0@lo:502: 00000100:00100000:3.0:1788636555.806466:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.806496:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a625f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.806510:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225909504 00000100:00100000:3.0:1788636555.806514:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225909504 00000100:00100000:3.0:1788636555.806538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788636555.806545:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:8480:x1875521225909504:12345-0@lo:502: 00000100:00100000:3.0:1788636555.806619:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:8480:x1875521225909504:12345-0@lo:502: Request processed in 74us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.806626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788636555.806660:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8480:1875521225909504:0@lo:502: 00000040:00080000:3.0:1788636555.806678:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788636555.806795:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788636555.806838:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788636555.806848:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.806859:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636555.806868:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788636555.806871:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf00324c000 from 5 10000000:01000000:3.0:1788636555.806873:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788636555.806897:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.806911:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.806920:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.806934:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225909632:0@lo:101: 00000100:00100000:3.0:1788636555.806962:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.806976:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026acba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.806989:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225909632 00000100:00100000:3.0:1788636555.806993:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225909632 00000100:00100000:3.0:1788636555.807015:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788636555.807037:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225909632:12345-0@lo:101: 00010000:00010000:3.0:1788636555.807047:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636555.807059:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838064 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83805d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.807082:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83805d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.807093:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83805d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.807101:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e000, rc 0) 00000100:00100000:3.0:1788636555.807132:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225909632:12345-0@lo:101: Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.807138:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788636555.807168:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225909632:0@lo:101: 00010000:00010000:3.0:1788636555.807188:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.807197:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.811053:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225909760:0@lo:256: 00000100:00100000:3.0:1788636555.811128:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.811168:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a625240 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.811206:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225909760 00000100:00100000:3.0:1788636555.811214:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225909760 00000100:00100000:3.0:1788636555.811257:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788636555.811266:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225909760:12345-0@lo:256: 20000000:01000000:3.0:1788636555.811287:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788636555.811304:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788636555.811307:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788636555.811395:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225909760:12345-0@lo:256: Request processed in 129us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.811404:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788636555.811451:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225909760:0@lo:256: 10000000:01000000:3.0:1788636555.811497:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788636555.811506:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.811517:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636555.811527:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788636555.811534:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788636555.811537:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788636555.811559:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.811567:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.811576:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.811589:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225909888:0@lo:101: 00000100:00100000:3.0:1788636555.811612:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.811626:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a625240 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.811636:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225909888 00000100:00100000:3.0:1788636555.811639:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225909888 00000100:00100000:3.0:1788636555.811660:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788636555.811666:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225909888:12345-0@lo:101: 00010000:00010000:3.0:1788636555.811674:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636555.811686:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153f400/0x5b741ef42e838072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83806b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.811708:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153f400/0x5b741ef42e838072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83806b expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.811718:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153f400/0x5b741ef42e838072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83806b expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.811726:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153f400, rc 0) 00000100:00100000:3.0:1788636555.811751:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225909888:12345-0@lo:101: Request processed in 85us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.811763:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788636555.811791:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225909888:0@lo:101: 00010000:00010000:3.0:1788636555.811803:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636555.811831:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.811880:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225910016:0@lo:501: 00000100:00100000:3.0:1788636555.811902:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.811915:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.811926:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225910016 00000100:00100000:3.0:1788636555.811929:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225910016 00000100:00100000:3.0:1788636555.811950:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788636555.811956:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225910016:12345-0@lo:501: 00000100:00100000:3.0:1788636555.812074:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225910016:12345-0@lo:501: Request processed in 117us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.812080:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788636555.812108:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225910016:0@lo:501: 00000100:00100000:3.0:1788636555.812133:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225910144:0@lo:503: 00000100:00100000:3.0:1788636555.812172:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.812183:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.812194:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225910144 00000100:00100000:3.0:1788636555.812197:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225910144 00000100:00100000:3.0:1788636555.812217:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788636555.812222:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225910144:12345-0@lo:503: 00000100:00100000:3.0:1788636555.812305:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225910144:12345-0@lo:503: Request processed in 82us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.812312:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788636555.812357:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225910144:0@lo:503: 00000100:00100000:2.0:1788636555.820467:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8482:1875521225910272:0@lo:502: 00000100:00100000:2.0:1788636555.820557:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636555.820594:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aa2d240 going to sleep for 11 seconds 00000001:00100000:2.0:1788636555.821430:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788636555.821532:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8478:x1875521225908736:12345-0@lo:700: Request processed in 52745us (53048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.821550:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636555.822988:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225910272 00000100:00100000:2.0:1788636555.823004:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225910272 00000100:00100000:2.0:1788636555.823082:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788636555.823093:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:8482:x1875521225910272:12345-0@lo:502: 00000100:00100000:2.0:1788636555.825047:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:8482:x1875521225910272:12345-0@lo:502: Request processed in 1949us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.825068:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1788636555.826420:0:8478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b1880 x1875521225908736/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788636571 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636555.826439:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8478:1875521225908736:0@lo:700: 00000100:00100000:2.0:1788636555.832134:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8482:1875521225910272:0@lo:502: 00000020:01000000:2.0:1788636555.832180:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788636555.832189:0:8482:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788636555.832206:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636555.832209:0:8482:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788636555.832216:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788636555.835864:0:8482:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:01000000:2.0:1788636555.835902:0:8482:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788636555.835907:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788636555.835922:0:8482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cef019d0000) 00000020:00000080:2.0:1788636555.835943:0:8482:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788636555.835949:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788636555.836070:0:8482:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788636555.836077:0:8482:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788636555.836085:0:8482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e838080 00010000:00080000:2.0:1788636555.836116:0:8482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf03fc1e000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.126@tcp at head 00010000:00010000:2.0:1788636555.836342:0:8482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000004:00080000:1.0:1788636555.852410:0:8478:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788636555.852448:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8478:1875521225910528:0@lo:7: 00000100:00100000:1.0:1788636555.852515:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.852562:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a620600 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.853887:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225910400:0@lo:13: 00000100:00100000:1.0:1788636555.853944:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.854359:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225910528 00000100:00100000:3.0:1788636555.854368:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225910528 00000100:00100000:3.0:1788636555.854424:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636555.854434:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8478:x1875521225910528:12345-0@lo:7: 00000100:00100000:0.0:1788636555.856052:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225910400 00000100:00100000:0.0:1788636555.856064:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225910400 00000100:00100000:0.0:1788636555.856190:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636555.856202:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875521225910400:12345-0@lo:13: 00002000:00000024:0.0:1788636555.856224:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:0.0:1788636555.856356:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875521225910400:12345-0@lo:13: Request processed in 156us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.856370:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788636555.862103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f1ee680 x1875521225910400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636555.862157:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225910400:0@lo:13: 00002000:00080000:3.0:1788636555.875493:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788636555.875504:0:8438:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788636555.875596:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8478:x1875521225910528:12345-0@lo:7: Request processed in 21159us (23077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.875607:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788636555.881651:0:8478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f1ef100 x1875521225910528/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788636571 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636555.881671:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8478:1875521225910528:0@lo:7: 00000004:00080000:3.0:1788636555.881687:0:8478:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788636555.881729:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8478:1875521225910656:0@lo:5: 00000100:00100000:3.0:1788636555.883642:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.883702:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ac44c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.883726:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225910656 00000100:00100000:3.0:1788636555.883734:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225910656 00000100:00100000:3.0:1788636555.884621:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636555.884636:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8478:x1875521225910656:12345-0@lo:5: 00002000:00080000:3.0:1788636555.884682:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788636555.884745:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8478:x1875521225910656:12345-0@lo:5: Request processed in 114us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.885883:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788636555.885952:0:8478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b7480 x1875521225910656/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636571 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636555.885969:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8478:1875521225910656:0@lo:5: 00000004:00080000:3.0:1788636555.885983:0:8478:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788636555.886040:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8478:1875521225910784:0@lo:5: 00000100:00100000:3.0:1788636555.886094:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.886749:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ac44c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.887988:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225910784 00000100:00100000:3.0:1788636555.888001:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225910784 00000100:00100000:3.0:1788636555.888076:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636555.888087:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8478:x1875521225910784:12345-0@lo:5: 00002000:00080000:3.0:1788636555.889888:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000040:01000000:2.0:1788636555.890391:0:8482:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788636555.890410:0:8482:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788636555.890629:0:8482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636555.893489:0:8482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636555.893665:0:8482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788636555.893752:0:8482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:3.0:1788636555.898968:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8478:x1875521225910784:12345-0@lo:5: Request processed in 10876us (12867us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788636555.898981:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788636555.899099:0:8478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b7480 x1875521225910784/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636571 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636555.899118:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8478:1875521225910784:0@lo:5: 00000004:00080000:3.0:1788636555.899132:0:8478:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788636555.899172:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8478:1875521225910912:0@lo:900: 00000100:00100000:3.0:1788636555.899205:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.899227:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ac44c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.899245:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225910912 00000100:00100000:3.0:1788636555.899257:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225910912 00000100:00100000:3.0:1788636555.899317:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636555.899324:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8478:x1875521225910912:12345-0@lo:900: 00000100:00100000:3.0:1788636555.899368:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8478:x1875521225910912:12345-0@lo:900: Request processed in 44us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636555.899375:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788636555.899401:0:8478:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b6a00 x1875521225910912/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788636571 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636555.899411:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8478:1875521225910912:0@lo:900: 00000020:00000080:0.0:1788636555.913285:0:8482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788636555.913302:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788636555.913344:0:8482:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788636555.913369:0:8482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e838087 00000100:00080000:0.0:1788636555.913381:0:8482:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788636555.913388:0:8482:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf03fc1e000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636555.913424:0:8482:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef019b1880 x1875521225911040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636555.913452:0:8482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788636555.913535:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636555.913540:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636555.913542:0:8482:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788636555.913545:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636555.913548:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636555.913549:0:8482:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788636555.913552:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788636555.913554:0:8482:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788636555.913583:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8482:1875521225911168:0@lo:502: 00000100:00100000:0.0:1788636555.913658:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.913691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225911168 00000100:00100000:0.0:1788636555.913698:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225911168 00000100:00100000:0.0:1788636555.913738:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788636555.913748:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:8482:x1875521225911168:12345-0@lo:502: 00000100:00100000:0.0:1788636555.913904:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:8482:x1875521225911168:12345-0@lo:502: Request processed in 157us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.913912:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788636555.913960:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0245be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636555.913987:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:8482:1875521225911168:0@lo:502: 00000020:01000000:0.0:1788636555.914047:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636555.914052:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636555.914054:0:8482:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788636555.914058:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788636555.914111:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788636555.914131:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788636555.914142:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.914154:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636555.914165:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788636555.914168:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf040b3b380 from 1 10000000:01000000:0.0:1788636555.914171:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788636555.914194:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.914203:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.914214:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.914227:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225911296:0@lo:101: 00000100:00100000:0.0:1788636555.914255:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.914272:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788636555.914285:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225911296 00000100:00100000:0.0:1788636555.914289:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225911296 00000100:00100000:0.0:1788636555.914321:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788636555.914327:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225911296:12345-0@lo:101: 00010000:00010000:0.0:1788636555.914337:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636555.914350:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83808e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.914373:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83808e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.914383:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83808e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.914392:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7600, rc 0) 00000100:00100000:0.0:1788636555.914421:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225911296:12345-0@lo:101: Request processed in 94us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.914428:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788636555.914460:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225911296:0@lo:101: 00010000:00010000:0.0:1788636555.914473:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.914482:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636555.914524:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225911424:0@lo:501: 00000100:00100000:0.0:1788636555.914550:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.914562:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788636555.914573:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225911424 00000100:00100000:0.0:1788636555.914577:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225911424 00000100:00100000:0.0:1788636555.914596:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788636555.914609:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225911424:12345-0@lo:501: 00000100:00100000:0.0:1788636555.914682:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225911424:12345-0@lo:501: Request processed in 73us (130us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636555.914688:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788636555.914713:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225911424:0@lo:501: 10000000:01000000:0.0:1788636555.914731:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788636555.914736:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636555.914743:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636555.915290:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521225911040:0@lo:8: 00000100:00100000:3.0:1788636555.915337:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788636555.917506:0:8487:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636555.917518:0:8487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1788636555.918099:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225911040 00000100:00100000:0.0:1788636555.918110:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225911040 00000100:00100000:0.0:1788636555.918337:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636555.918346:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521225911040:12345-0@lo:8: 00010000:00080000:0.0:1788636555.918381:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:0.0:1788636555.918410:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e83809c 00002000:00100000:0.0:1788636555.918427:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cf03ab4f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788636555.918432:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788636555.918435:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788636555.918512:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788636555.918539:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9cf03ab4d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636555.918627:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875521225911040:12345-0@lo:8: Request processed in 281us (3288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.918636:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788636555.918711:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b1880 x1875521225911040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636555.918721:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788636555.918731:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788636555.918738:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788636555.918743:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788636555.918745:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc1e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788636555.918768:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788636555.918774:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521225911040:0@lo:8: 00000004:00080000:1.0:1788636555.919704:0:8487:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788636555.921003:0:8487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 224732192940ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788636555.921014:0:8487:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788636555.922316:0:8488:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788636555.922347:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1875521225911680:0@lo:7: 00000100:00100000:1.0:1788636555.922433:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636555.922478:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225911680 00000100:00100000:1.0:1788636555.922485:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225911680 00000100:00100000:1.0:1788636555.922540:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636555.922549:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8488:x1875521225911680:12345-0@lo:7: 00000100:00100000:0.0:1788636555.924669:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225911552:0@lo:13: 00000100:00100000:0.0:1788636555.924746:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.925843:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225911552 00000100:00100000:0.0:1788636555.925852:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225911552 00000100:00100000:0.0:1788636555.925901:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636555.925910:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875521225911552:12345-0@lo:13: 00002000:00000024:0.0:1788636555.925935:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1788636555.926012:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875521225911552:12345-0@lo:13: Request processed in 102us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.926028:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788636555.926091:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f1ee680 x1875521225911552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636555.926111:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225911552:0@lo:13: 00000100:00100000:0.0:1788636555.927006:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e900 going to sleep for 11 seconds 00000100:00080000:1.0:1788636555.927500:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788636555.927949:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788636555.932099:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636555.932138:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225911808:0@lo:41: 00000100:00100000:0.0:1788636555.932214:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.932271:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225911808 00000100:00100000:0.0:1788636555.932280:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225911808 00000100:00100000:0.0:1788636555.932332:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788636555.932342:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225911808:12345-0@lo:41: 00000004:00000024:0.0:1788636555.932379:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788636555.932427:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225911808:12345-0@lo:41: Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.932435:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788636555.932487:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225911808:0@lo:41: 00002000:00080000:1.0:1788636555.935354:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788636555.935369:0:8438:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788636555.935516:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8488:x1875521225911680:12345-0@lo:7: Request processed in 12962us (13077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636555.935528:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788636555.937687:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f1ef100 x1875521225911680/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788636571 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636555.937718:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1875521225911680:0@lo:7: 00000004:00080000:0.0:1788636555.937735:0:8488:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788636555.946879:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1875521225911936:0@lo:5: 00000100:00100000:1.0:1788636555.946951:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.949533:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225911936 00000100:00100000:3.0:1788636555.949550:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225911936 00000100:00100000:3.0:1788636555.949649:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636555.949661:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8488:x1875521225911936:12345-0@lo:5: 00002000:00080000:3.0:1788636555.949713:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788636555.949718:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788636555.955270:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00100000:3.0:1788636555.955290:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788636555.955296:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1788636555.955522:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8488:x1875521225911936:12345-0@lo:5: Request processed in 5859us (8565us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788636555.955533:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636555.955915:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 11 seconds 00010000:00080000:0.0:1788636555.955948:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03aba6300 x1875521225911936/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636571 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636555.955971:0:8488:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788636555.955978:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1875521225911936:0@lo:5: 00000004:00080000:0.0:1788636555.955994:0:8488:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788636555.956055:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1875521225912064:0@lo:700: 00000100:00100000:0.0:1788636555.956096:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.956137:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788636555.956371:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225912064 00000100:00100000:3.0:1788636555.956379:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225912064 00000100:00100000:3.0:1788636555.956420:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636555.956429:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8488:x1875521225912064:12345-0@lo:700: 00000100:00100000:2.0:1788636555.973522:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8488:x1875521225912064:12345-0@lo:700: Request processed in 17082us (17413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.973553:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788636555.973650:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b3b80 x1875521225912064/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788636571 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636555.973666:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1875521225912064:0@lo:700: 00000004:02000040:0.0:1788636555.975572:0:8488:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788636555.985362:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1875521225912192:0@lo:5: 00000100:00100000:3.0:1788636555.985441:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636555.985558:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ac44c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636555.989389:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225912192 00000100:00100000:1.0:1788636555.989410:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225912192 00000100:00100000:0.0:1788636556.000508:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788636556.000523:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8488:x1875521225912192:12345-0@lo:5: 00002000:00080000:0.0:1788636556.009687:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788636556.009725:0:8438:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788636556.017361:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8488:x1875521225912192:12345-0@lo:5: Request processed in 16830us (31910us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788636556.017376:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788636556.018982:0:8488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b6d80 x1875521225912192/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636571 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636556.019001:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8488:1875521225912192:0@lo:5: 00000004:00080000:1.0:1788636556.019028:0:8488:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:0.0:1788636556.694857:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788636556.845247:0:8522:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788636556.845502:0:8522:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788636556.949242:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636556.949277:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225912320:0@lo:41: 00000100:00100000:1.0:1788636556.949386:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636556.949452:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225912320 00000100:00100000:1.0:1788636556.949459:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225912320 00000100:00100000:1.0:1788636556.949508:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788636556.949517:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225912320:12345-0@lo:41: 00000004:00000024:1.0:1788636556.949564:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788636556.949609:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225912320:12345-0@lo:41: Request processed in 93us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636556.949616:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788636556.949659:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225912320:0@lo:41: 00010000:00010000:0.0:1788636557.717430:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636558.741905:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636559.765660:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636560.789063:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636561.046457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225912448:0@lo:41: 00000100:00100000:0.0:1788636561.046552:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636561.046657:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225912448 00000100:00100000:0.0:1788636561.046667:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225912448 00000100:00100000:0.0:1788636561.046719:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788636561.046729:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225912448:12345-0@lo:41: 00000004:00000024:0.0:1788636561.046768:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788636561.046841:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225912448:12345-0@lo:41: Request processed in 113us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636561.046848:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788636561.046910:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225912448:0@lo:41: 00000100:00100000:2.0:1788636561.047120:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225912576:0@lo:400: 00000100:00100000:2.0:1788636561.047157:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636561.047567:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225913088:0@lo:400: 00000100:00100000:2.0:1788636561.047650:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636561.047681:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788636561.047689:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225912704:0@lo:400: 00000100:00100000:2.0:1788636561.047713:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636561.047731:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225913216:0@lo:400: 00000100:00100000:2.0:1788636561.047754:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636561.047788:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225913088 00000100:00100000:2.0:1788636561.047794:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225913088 00000100:00100000:2.0:1788636561.047867:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225912704 00000100:00100000:2.0:1788636561.047871:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225912704 00000100:00100000:2.0:1788636561.047883:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225913216 00000100:00100000:2.0:1788636561.047885:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225913216 00000100:00100000:2.0:1788636561.047913:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636561.047922:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225913088:12345-0@lo:400: 00000100:00100000:2.0:1788636561.047966:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225913088:12345-0@lo:400: Request processed in 46us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636561.047973:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636561.047988:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636561.047994:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225912704:12345-0@lo:400: 00000100:00100000:2.0:1788636561.048019:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225912704:12345-0@lo:400: Request processed in 26us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636561.048033:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636561.048045:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788636561.048051:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225913216:12345-0@lo:400: 00000100:00100000:2.0:1788636561.048081:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225913216:12345-0@lo:400: Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636561.048087:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788636561.048108:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636561.048112:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636561.048122:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225912960:0@lo:400: 00000100:00100000:2.0:1788636561.048147:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636561.048165:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225913472:0@lo:400: 00000100:00100000:2.0:1788636561.048297:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636561.048322:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788636561.048329:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225912832:0@lo:400: 00000100:00100000:2.0:1788636561.048353:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636561.048378:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225913344:0@lo:400: 00000100:00100000:2.0:1788636561.048402:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636561.048428:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225913472 00000100:00100000:2.0:1788636561.048432:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225913472 00000100:00100000:2.0:1788636561.048462:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225913344 00000100:00100000:2.0:1788636561.048465:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225913344 00000100:00100000:2.0:1788636561.048480:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636561.048486:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875521225913472:12345-0@lo:400: 00000100:00100000:2.0:1788636561.048524:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875521225913472:12345-0@lo:400: Request processed in 38us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636561.048529:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636561.048551:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636561.048556:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225913344:12345-0@lo:400: 00000100:00100000:2.0:1788636561.048583:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225913344:12345-0@lo:400: Request processed in 28us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636561.048589:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636561.048608:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225912832 00000100:00100000:2.0:1788636561.048611:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225912832 00000100:00100000:2.0:1788636561.048636:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788636561.048644:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225912832:12345-0@lo:400: 00000100:00100000:2.0:1788636561.048675:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225912832:12345-0@lo:400: Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636561.048681:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788636561.048700:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636561.048710:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225912960 00000100:00100000:2.0:1788636561.048713:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225912960 00000100:00100000:2.0:1788636561.048732:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636561.048738:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225912960:12345-0@lo:400: 00000100:00100000:2.0:1788636561.048780:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225912960:12345-0@lo:400: Request processed in 42us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636561.048786:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788636561.048847:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040993800 x1875521225912704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636561.048858:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225912704:0@lo:400: 00010000:00080000:2.0:1788636561.048870:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040991c00 x1875521225913216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636561.048879:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225913216:0@lo:400: 00010000:00080000:2.0:1788636561.048915:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040991880 x1875521225913088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636561.048923:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225913088:0@lo:400: 00000100:00100000:2.0:1788636561.048958:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225912832:0@lo:400: 00010000:00080000:2.0:1788636561.048969:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040992300 x1875521225913344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636561.048975:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788636561.048985:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225913344:0@lo:400: 00010000:00080000:2.0:1788636561.048995:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040990380 x1875521225912960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636561.049002:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225912960:0@lo:400: 00010000:00080000:2.0:1788636561.049012:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040992d80 x1875521225913472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636561.049019:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225913472:0@lo:400: 00000100:00100000:3.0:1788636561.049369:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636561.049380:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225913600:0@lo:13: 00000100:00100000:3.0:1788636561.049414:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636561.049450:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225913600 00000100:00100000:3.0:1788636561.049454:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225913600 00000100:00100000:3.0:1788636561.049486:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636561.049493:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521225913600:12345-0@lo:13: 00002000:00000024:3.0:1788636561.049516:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636561.049552:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521225913600:12345-0@lo:13: Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636561.049558:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788636561.049587:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b5500 x1875521225913600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636561.049601:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225913600:0@lo:13: 00000100:00100000:0.0:1788636561.049695:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225912576 00000100:00100000:0.0:1788636561.049700:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225912576 00000100:00100000:0.0:1788636561.049740:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788636561.049748:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3648:x1875521225912576:12345-0@lo:400: 00000100:00100000:0.0:1788636561.049796:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3648:x1875521225912576:12345-0@lo:400: Request processed in 49us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636561.049803:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788636561.049970:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225912576:0@lo:400: 00000100:00100000:0.0:1788636561.053215:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225913728:0@lo:13: 00000100:00100000:0.0:1788636561.053297:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636561.053432:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225913728 00000100:00100000:3.0:1788636561.053441:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225913728 00000100:00100000:3.0:1788636561.053497:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636561.053507:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225913728:12345-0@lo:13: 00002000:00000024:3.0:1788636561.053531:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636561.053593:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225913728:12345-0@lo:13: Request processed in 74us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636561.053601:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788636561.057442:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b5500 x1875521225913728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636561.057476:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225913728:0@lo:13: 00010000:00010000:1.0:1788636561.813010:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636562.072192:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225913856:0@lo:41: 00000100:00100000:0.0:1788636562.072262:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636562.073127:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225913856 00000100:00100000:3.0:1788636562.073141:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225913856 00000100:00100000:3.0:1788636562.073202:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788636562.073212:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225913856:12345-0@lo:41: 00000004:00000024:3.0:1788636562.073249:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788636562.073321:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225913856:12345-0@lo:41: Request processed in 109us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636562.073328:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788636562.080080:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225913856:0@lo:41: 00000001:00080000:0.0:1788636562.092276:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1788636562.837127:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636563.862794:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636564.895717:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788636565.036970:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788636565.913296:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636566.165891:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636566.165917:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225913984:0@lo:41: 00000100:00100000:0.0:1788636566.165991:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636566.166057:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225913984 00000100:00100000:0.0:1788636566.166065:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225913984 00000100:00100000:0.0:1788636566.166112:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788636566.166122:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225913984:12345-0@lo:41: 00000004:00000024:0.0:1788636566.166159:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788636566.166219:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225913984:12345-0@lo:41: Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636566.166226:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788636566.166516:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225913984:0@lo:41: 00000100:00100000:0.0:1788636566.175213:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225914240:0@lo:400: 00000100:00100000:0.0:1788636566.175299:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636566.175342:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225914752:0@lo:400: 00000100:00100000:0.0:1788636566.175368:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636566.175396:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788636566.175402:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225914112:0@lo:400: 00000100:00100000:0.0:1788636566.175432:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636566.175453:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521225914624:0@lo:400: 00000100:00100000:0.0:1788636566.175476:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636566.175502:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225914368:0@lo:400: 00000100:00100000:0.0:1788636566.175525:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636566.175541:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225914880:0@lo:400: 00000100:00100000:0.0:1788636566.175560:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636566.175578:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788636566.175583:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225914496:0@lo:400: 00000100:00100000:0.0:1788636566.175625:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636566.175641:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225915008:0@lo:400: 00000100:00100000:0.0:1788636566.175661:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636566.175692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225914112 00000100:00100000:0.0:1788636566.175699:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225914112 00000100:00100000:0.0:1788636566.175741:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788636566.175750:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3649:x1875521225914112:12345-0@lo:400: 00000100:00100000:0.0:1788636566.175836:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3649:x1875521225914112:12345-0@lo:400: Request processed in 86us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636566.175852:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788636566.175907:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225914112:0@lo:400: 00000100:00100000:2.0:1788636566.176117:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225914240 00000100:00100000:2.0:1788636566.176122:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225914240 00000100:00100000:2.0:1788636566.176151:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225914752 00000100:00100000:2.0:1788636566.176154:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225914752 00000100:00100000:2.0:1788636566.177119:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225914624 00000100:00100000:2.0:1788636566.177126:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225914624 00000100:00100000:3.0:1788636566.177484:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225914368 00000100:00100000:3.0:1788636566.177489:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225914368 00000100:00100000:3.0:1788636566.177623:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788636566.177633:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225914368:12345-0@lo:400: 00000100:00100000:3.0:1788636566.177760:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225914368:12345-0@lo:400: Request processed in 128us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636566.177767:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788636566.177823:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225915136:0@lo:13: 00000100:00100000:3.0:1788636566.177864:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636566.178009:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225914368:0@lo:400: 00000100:00100000:3.0:1788636566.178033:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225915136 00000100:00100000:3.0:1788636566.178036:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225915136 00000100:00080000:0.0:1788636566.184607:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636566.184620:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636566.184624:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636566.185114:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225914880 00000100:00100000:0.0:1788636566.185126:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225914880 00000100:00100000:0.0:1788636566.185203:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225915008 00000100:00100000:0.0:1788636566.185206:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225915008 00000100:00100000:0.0:1788636566.185237:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636566.185246:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875521225914880:12345-0@lo:400: 00000100:00100000:0.0:1788636566.185354:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875521225914880:12345-0@lo:400: Request processed in 109us (9791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636566.185362:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636566.185379:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636566.185386:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225915008:12345-0@lo:400: 00000100:00100000:0.0:1788636566.185413:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225915008:12345-0@lo:400: Request processed in 29us (9750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636566.185418:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636566.185437:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225914496 00000100:00100000:0.0:1788636566.185441:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225914496 00000100:00100000:0.0:1788636566.185459:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636566.185465:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225914240:12345-0@lo:400: 00000100:00100000:0.0:1788636566.185496:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225914240:12345-0@lo:400: Request processed in 31us (10199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636566.185508:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636566.185521:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636566.185542:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225914752:12345-0@lo:400: 00000100:00100000:0.0:1788636566.185578:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225914752:12345-0@lo:400: Request processed in 38us (10210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636566.185583:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636566.185596:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636566.185602:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225914496:12345-0@lo:400: 00000100:00100000:0.0:1788636566.185627:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225914496:12345-0@lo:400: Request processed in 27us (10002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636566.185633:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788636566.185649:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636566.191381:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225915264:0@lo:13: 00000100:00100000:0.0:1788636566.191461:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788636566.191518:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b2a00 x1875521225914240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636566.191532:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225914240:0@lo:400: 00010000:00080000:0.0:1788636566.191544:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f17a300 x1875521225914752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636566.191550:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636566.191553:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225914752:0@lo:400: 00000100:00100000:2.0:1788636566.191562:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521225914624:12345-0@lo:400: 00000100:00100000:0.0:1788636566.191589:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225915264 00000100:00100000:0.0:1788636566.191595:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225915264 00000100:00100000:0.0:1788636566.191618:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636566.191625:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225915264:12345-0@lo:13: 00002000:00000024:0.0:1788636566.191647:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636566.191656:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521225914624:12345-0@lo:400: Request processed in 97us (16178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636566.191662:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636566.191675:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225915264:12345-0@lo:13: Request processed in 52us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636566.191690:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788636566.191714:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03aba4a80 x1875521225915264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636566.191721:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788636566.191738:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225915264:0@lo:13: 00010000:00080000:2.0:1788636566.191749:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f1ee680 x1875521225914624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636566.191757:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521225914624:0@lo:400: 00010000:00080000:2.0:1788636566.191797:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f1ef100 x1875521225914496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636566.191969:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225914496:0@lo:400: 00010000:00080000:2.0:1788636566.191985:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f179880 x1875521225915008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636566.191993:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225915008:0@lo:400: 00010000:00080000:2.0:1788636566.192005:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f178700 x1875521225914880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636566.192012:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225914880:0@lo:400: 00000100:00100000:3.0:1788636566.192118:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788636566.192127:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225915136:12345-0@lo:13: 00002000:00000024:3.0:1788636566.192139:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636566.192187:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225915136:12345-0@lo:13: Request processed in 50us (14311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636566.192193:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788636566.192376:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b4700 x1875521225915136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636566.192388:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225915136:0@lo:13: 00000020:00000004:0.0:1788636566.319531:0:8865:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788636566.319768:0:8865:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788636566.943051:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636567.194071:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636567.194106:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225915392:0@lo:41: 00000100:00100000:1.0:1788636567.194318:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636567.197730:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225915392 00000100:00100000:0.0:1788636567.197771:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225915392 00000100:00100000:0.0:1788636567.197883:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788636567.197897:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225915392:12345-0@lo:41: 00000004:00000024:0.0:1788636567.197959:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788636567.198072:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225915392:12345-0@lo:41: Request processed in 178us (3754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636567.198080:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788636567.199068:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02462680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225915392:0@lo:41: 00010000:00010000:2.0:1788636567.957604:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636568.987397:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636570.005610:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788636570.149877:0:8966:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636570.151771:0:8966:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788636571.029556:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788636571.204687:0:9014:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788636571.204701:0:9014:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1788636571.286208:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636571.286239:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225915520:0@lo:13: 00000100:00100000:2.0:1788636571.286294:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636571.286480:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225915648:0@lo:400: 00000100:00100000:0.0:1788636571.286568:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636571.286585:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225916160:0@lo:400: 00000100:00100000:0.0:1788636571.286601:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636571.286610:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225916672:0@lo:41: 00000100:00100000:0.0:1788636571.286619:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636571.286631:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788636571.286634:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225915776:0@lo:400: 00000100:00100000:0.0:1788636571.286647:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636571.286663:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225916288:0@lo:400: 00000100:00100000:0.0:1788636571.286691:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636571.286722:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225916032:0@lo:400: 00000100:00100000:0.0:1788636571.286743:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636571.286760:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225916544:0@lo:400: 00000100:00100000:0.0:1788636571.286778:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636571.286792:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788636571.286796:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225915904:0@lo:400: 00000100:00100000:0.0:1788636571.286834:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636571.286850:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521225916416:0@lo:400: 00000100:00100000:0.0:1788636571.286867:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636571.286887:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225916160 00000100:00100000:0.0:1788636571.286894:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225916160 00000100:00100000:3.0:1788636571.287184:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225915520 00000100:00100000:3.0:1788636571.287194:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225915520 00000100:00100000:3.0:1788636571.287250:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636571.287260:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225915520:12345-0@lo:13: 00002000:00000024:3.0:1788636571.287289:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636571.287332:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225915520:12345-0@lo:13: Request processed in 74us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.287338:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636571.287361:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225915648 00000100:00100000:3.0:1788636571.287365:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225915648 00000100:00100000:3.0:1788636571.287391:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788636571.287397:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3648:x1875521225915648:12345-0@lo:400: 00000100:00100000:3.0:1788636571.287425:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3648:x1875521225915648:12345-0@lo:400: Request processed in 28us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.287431:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788636571.287453:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225916672 00000100:00100000:3.0:1788636571.287457:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225916672 00000100:00100000:3.0:1788636571.287472:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225915904 00000100:00100000:3.0:1788636571.287474:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225915904 00000100:00100000:3.0:1788636571.287486:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788636571.287491:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521225916672:12345-0@lo:41: 00000100:00080000:2.0:1788636571.287592:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00000024:3.0:1788636571.287629:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788636571.287660:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521225916672:12345-0@lo:41: Request processed in 168us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.287667:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788636571.287691:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788636571.287697:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225915904:12345-0@lo:400: 00000100:00100000:3.0:1788636571.287776:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225915904:12345-0@lo:400: Request processed in 78us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.287789:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788636571.287899:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788636571.287907:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225916160:12345-0@lo:400: 00000100:00100000:0.0:1788636571.287937:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225916160:12345-0@lo:400: Request processed in 31us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.287943:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788636571.287961:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225915776 00000100:00100000:0.0:1788636571.287964:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225915776 00000100:00100000:0.0:1788636571.287982:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225916288 00000100:00100000:0.0:1788636571.287984:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225916288 00000100:00100000:0.0:1788636571.288005:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225916032 00000100:00100000:0.0:1788636571.288008:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225916032 00000100:00100000:0.0:1788636571.288019:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225916416 00000100:00100000:0.0:1788636571.288022:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225916416 00000100:00100000:0.0:1788636571.288035:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788636571.288041:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225915776:12345-0@lo:400: 00000100:00100000:0.0:1788636571.288077:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225915776:12345-0@lo:400: Request processed in 36us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.288083:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788636571.288107:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636571.288113:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225916288:12345-0@lo:400: 00000100:00100000:0.0:1788636571.288139:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225916288:12345-0@lo:400: Request processed in 27us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.288145:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636571.288159:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636571.288164:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225916032:12345-0@lo:400: 00000100:00100000:0.0:1788636571.288188:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225916032:12345-0@lo:400: Request processed in 23us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.288193:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636571.288203:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788636571.288209:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521225916416:12345-0@lo:400: 00000100:00100000:0.0:1788636571.288233:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521225916416:12345-0@lo:400: Request processed in 25us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.288238:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788636571.288263:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225916544 00000100:00100000:0.0:1788636571.288267:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225916544 00000100:00100000:0.0:1788636571.288291:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636571.288299:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225916544:12345-0@lo:400: 00000100:00100000:0.0:1788636571.288327:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225916544:12345-0@lo:400: Request processed in 28us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.288332:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636571.288367:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225916800:0@lo:13: 00000100:00100000:0.0:1788636571.288397:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788636571.288422:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636571.288425:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636571.288426:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788636571.288449:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b7100 x1875521225915520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636571.288518:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225916800 00000100:00100000:3.0:1788636571.288521:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225916800 00000100:00100000:3.0:1788636571.288544:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636571.288550:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225916800:12345-0@lo:13: 00002000:00000024:3.0:1788636571.288562:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636571.288592:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225916800:12345-0@lo:13: Request processed in 42us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.288598:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788636571.288624:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef02460380 x1875521225916800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636571.288637:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225916800:0@lo:13: 00000100:00100000:0.0:1788636571.288768:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225915520:0@lo:13: 00010000:00080000:0.0:1788636571.288799:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef023fd880 x1875521225915776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636571.288865:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225915776:0@lo:400: 00010000:00080000:0.0:1788636571.288880:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef023fe300 x1875521225916288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636571.288889:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225916288:0@lo:400: 00000100:00100000:0.0:1788636571.288898:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225915648:0@lo:400: 00000100:00100000:0.0:1788636571.288908:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225916160:0@lo:400: 00000100:00100000:0.0:1788636571.288919:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225916672:0@lo:41: 00000100:00100000:2.0:1788636571.289156:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225915904:0@lo:400: 00010000:00080000:2.0:1788636571.289168:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef023fdc00 x1875521225916416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636571.289177:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521225916416:0@lo:400: 00010000:00080000:2.0:1788636571.289187:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef023ffb80 x1875521225916032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636571.289194:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225916032:0@lo:400: 00010000:00080000:2.0:1788636571.289204:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef023fea00 x1875521225916544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636571.289211:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225916544:0@lo:400: 00010000:00010000:2.0:1788636572.054429:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636572.319328:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636572.323142:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225916928:0@lo:41: 00000100:00100000:2.0:1788636572.323223:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636572.323420:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225916928 00000100:00100000:1.0:1788636572.323431:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225916928 00000100:00100000:1.0:1788636572.323510:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788636572.323524:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225916928:12345-0@lo:41: 00000004:00000024:1.0:1788636572.323566:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788636572.323661:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225916928:12345-0@lo:41: Request processed in 139us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636572.323670:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788636572.323904:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225916928:0@lo:41: 00010000:00010000:3.0:1788636573.077051:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636574.102284:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636575.136744:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636576.149987:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636576.405235:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225917056:0@lo:41: 00000100:00100000:0.0:1788636576.405308:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636576.405377:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225917568:0@lo:400: 00000100:00100000:0.0:1788636576.405401:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636576.405437:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225918080:0@lo:400: 00000100:00100000:0.0:1788636576.405462:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636576.405489:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788636576.405504:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225917568 00000100:00100000:0.0:1788636576.405515:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225917440:0@lo:400: 00000100:00100000:1.0:1788636576.405518:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225917568 00000100:00100000:0.0:1788636576.405542:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636576.405592:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225917952:0@lo:400: 00000100:00100000:1.0:1788636576.405597:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788636576.405606:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225917568:12345-0@lo:400: 00000100:00100000:0.0:1788636576.405611:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636576.405646:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225917056 00000100:00100000:0.0:1788636576.405650:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225917056 00000100:00100000:0.0:1788636576.405675:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225917440 00000100:00100000:1.0:1788636576.405676:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225917568:12345-0@lo:400: Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636576.405678:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225917440 00000100:00100000:1.0:1788636576.405683:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788636576.405691:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788636576.405696:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225917056:12345-0@lo:41: 00000004:00000024:0.0:1788636576.405727:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788636576.405761:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225917056:12345-0@lo:41: Request processed in 65us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636576.405767:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788636576.405780:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788636576.405785:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225917440:12345-0@lo:400: 00000100:00100000:0.0:1788636576.405846:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225917440:12345-0@lo:400: Request processed in 60us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636576.405853:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788636576.405900:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225918080 00000100:00100000:1.0:1788636576.405904:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225918080 00000100:00100000:3.0:1788636576.405925:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225917312:0@lo:400: 00000100:00100000:3.0:1788636576.405952:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636576.406111:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225917952 00000100:00100000:0.0:1788636576.406115:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225917952 00000100:00100000:1.0:1788636576.406338:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636576.406346:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225918080:12345-0@lo:400: 00000100:00100000:1.0:1788636576.406379:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225918080:12345-0@lo:400: Request processed in 35us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636576.406385:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636576.406633:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225917184:0@lo:400: 00000100:00100000:0.0:1788636576.407767:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636576.407779:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225917952:12345-0@lo:400: 00000100:00100000:1.0:1788636576.409430:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636576.409457:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225917824:0@lo:400: 00000100:00100000:1.0:1788636576.409477:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225917696:0@lo:400: 00000100:00100000:3.0:1788636576.409496:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636576.409533:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225918336:0@lo:13: 00000100:00100000:1.0:1788636576.409539:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636576.409567:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225918208:0@lo:13: 00000100:00100000:3.0:1788636576.409570:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636576.409588:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636576.409607:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225918336 00000100:00100000:1.0:1788636576.409612:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225917312 00000100:00100000:3.0:1788636576.409615:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225918336 00000100:00100000:1.0:1788636576.409615:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225917312 00000100:00100000:3.0:1788636576.409649:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225918208 00000100:00100000:1.0:1788636576.409649:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225917824 00000100:00100000:3.0:1788636576.409651:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225918208 00000100:00100000:1.0:1788636576.409651:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225917824 00000100:00100000:1.0:1788636576.409667:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225917696 00000100:00100000:1.0:1788636576.409669:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225917696 00000100:00100000:3.0:1788636576.409683:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788636576.409683:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636576.409690:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875521225918336:12345-0@lo:13: 00000100:00100000:1.0:1788636576.409690:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225917312:12345-0@lo:400: 00002000:00000024:3.0:1788636576.409719:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636576.409737:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225917312:12345-0@lo:400: Request processed in 47us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636576.409745:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875521225918336:12345-0@lo:13: Request processed in 56us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636576.409745:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636576.409750:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636576.409763:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636576.409763:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636576.409768:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225918208:12345-0@lo:13: 00000100:00100000:1.0:1788636576.409769:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225917824:12345-0@lo:400: 00002000:00000024:3.0:1788636576.409777:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636576.409792:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225917824:12345-0@lo:400: Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636576.409799:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225918208:12345-0@lo:13: Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636576.409799:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636576.409823:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636576.409835:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788636576.409841:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225917696:12345-0@lo:400: 00010000:00080000:3.0:1788636576.409867:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b4380 x1875521225918208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636576.409889:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225918208:0@lo:13: 00010000:00080000:3.0:1788636576.409911:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03aba6680 x1875521225917696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636576.409920:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225917696:0@lo:400: 00010000:00080000:3.0:1788636576.409947:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef02461880 x1875521225918336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636576.409957:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225918336:0@lo:13: 00010000:00080000:3.0:1788636576.409968:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03aba5500 x1875521225917312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636576.409976:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225917312:0@lo:400: 00010000:00080000:3.0:1788636576.409995:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03aba7100 x1875521225917824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636576.410002:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225917824:0@lo:400: 00000100:00100000:2.0:1788636576.411180:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225917184 00000100:00100000:2.0:1788636576.411193:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225917184 00000100:00100000:2.0:1788636576.411250:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788636576.411260:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3648:x1875521225917184:12345-0@lo:400: 00000100:00100000:2.0:1788636576.419941:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3648:x1875521225917184:12345-0@lo:400: Request processed in 8670us (10503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636576.419961:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788636576.419973:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225917184:0@lo:400: 00000100:00100000:1.0:1788636576.420239:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225917696:12345-0@lo:400: Request processed in 10396us (10696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636576.420250:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788636576.420899:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225917440:0@lo:400: 00000100:00100000:0.0:1788636576.420914:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225917952:12345-0@lo:400: Request processed in 13135us (15298us total) trans 0 rc 0/0 00010000:00080000:2.0:1788636576.420920:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03aba4380 x1875521225917952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636576.420924:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636576.420932:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225917952:0@lo:400: 00010000:00080000:2.0:1788636576.420945:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03aba4000 x1875521225918080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636576.420956:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225918080:0@lo:400: 00000100:00080000:0.0:1788636576.420959:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636576.420965:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636576.420980:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636576.421089:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03aba4700 x1875521225917568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636576.421098:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225917568:0@lo:400: 00000100:00100000:2.0:1788636576.421125:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225917056:0@lo:41: 00010000:00010000:0.0:1788636577.176062:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636577.437689:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225918464:0@lo:41: 00000100:00100000:1.0:1788636577.437790:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636577.438129:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225918464 00000100:00100000:1.0:1788636577.438137:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225918464 00000100:00100000:1.0:1788636577.438193:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788636577.438203:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225918464:12345-0@lo:41: 00000004:00000024:1.0:1788636577.438344:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788636577.438394:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225918464:12345-0@lo:41: Request processed in 193us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636577.438402:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788636577.438446:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225918464:0@lo:41: 00010000:00010000:0.0:1788636578.198379:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636579.230587:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636580.245434:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636581.269187:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636581.525023:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225918592:0@lo:13: 00000100:00100000:3.0:1788636581.525112:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636581.525195:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225918592 00000100:00100000:3.0:1788636581.525205:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225918592 00000100:00100000:3.0:1788636581.525266:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636581.525278:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225918592:12345-0@lo:13: 00002000:00000024:3.0:1788636581.525316:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636581.525370:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225918592:12345-0@lo:13: Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636581.525377:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788636581.525421:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b4380 x1875521225918592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636581.525451:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225918592:0@lo:13: 00000100:00080000:0.0:1788636581.527200:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636581.527324:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225918720:0@lo:13: 00000100:00100000:3.0:1788636581.527397:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636581.527464:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636581.527471:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225918848:0@lo:41: 00000100:00100000:3.0:1788636581.527498:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636581.527535:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225918848 00000100:00100000:3.0:1788636581.527553:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225918848 00000100:00100000:3.0:1788636581.527610:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788636581.527619:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225918848:12345-0@lo:41: 00000004:00000024:3.0:1788636581.527670:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788636581.527719:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225918848:12345-0@lo:41: Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636581.527726:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788636581.527776:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225918848:0@lo:41: 00000100:00100000:0.0:1788636581.528164:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225918720 00000100:00100000:0.0:1788636581.528169:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225918720 00000100:00100000:0.0:1788636581.528212:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788636581.528220:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225918720:12345-0@lo:13: 00002000:00000024:0.0:1788636581.528240:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636581.528288:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225918720:12345-0@lo:13: Request processed in 69us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636581.528312:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788636581.531180:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636581.531274:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef023ff800 x1875521225918720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636597 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636581.531319:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225918720:0@lo:13: 00000100:00100000:3.0:1788636581.539959:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225919360:0@lo:400: 00000100:00100000:1.0:1788636581.540131:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225918976:0@lo:400: 00000100:00100000:0.0:1788636581.540623:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225919104:0@lo:400: 00000100:00100000:1.0:1788636581.541180:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636581.541238:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225919488:0@lo:400: 00000100:00100000:1.0:1788636581.541282:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636581.541363:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225918976 00000100:00100000:1.0:1788636581.541375:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225918976 00000100:00100000:1.0:1788636581.541446:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788636581.541457:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3646:x1875521225918976:12345-0@lo:400: 00000100:00100000:1.0:1788636581.541518:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3646:x1875521225918976:12345-0@lo:400: Request processed in 62us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636581.542850:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636581.542887:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521225919616:0@lo:400: 00000100:00100000:0.0:1788636581.542924:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636581.542975:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225919488 00000100:00100000:0.0:1788636581.542982:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225919488 00000100:00100000:0.0:1788636581.543030:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225919104 00000100:00100000:0.0:1788636581.543034:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225919104 00000100:00100000:0.0:1788636581.543048:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225919616 00000100:00100000:0.0:1788636581.543050:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225919616 00000100:00100000:0.0:1788636581.543067:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788636581.543077:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225919488:12345-0@lo:400: 00000100:00100000:0.0:1788636581.543126:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225919488:12345-0@lo:400: Request processed in 51us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636581.543134:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788636581.543155:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788636581.543173:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225919104:12345-0@lo:400: 00000100:00100000:0.0:1788636581.543208:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225919104:12345-0@lo:400: Request processed in 37us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636581.543215:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788636581.543229:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788636581.543235:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521225919616:12345-0@lo:400: 00000100:00100000:0.0:1788636581.543260:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521225919616:12345-0@lo:400: Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636581.543265:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788636581.543305:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b4000 x1875521225919104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636581.543322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225919104:0@lo:400: 00010000:00080000:0.0:1788636581.543348:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf032407b80 x1875521225919616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636581.543357:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521225919616:0@lo:400: 00000100:00100000:3.0:1788636581.543474:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636581.543505:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636581.543513:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225919232:0@lo:400: 00000100:00100000:3.0:1788636581.543552:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636581.543584:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225919232 00000100:00100000:3.0:1788636581.543588:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225919232 00000100:00100000:3.0:1788636581.543617:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788636581.543625:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225919232:12345-0@lo:400: 00000100:00100000:3.0:1788636581.543662:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225919232:12345-0@lo:400: Request processed in 37us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636581.543668:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788636581.543686:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636581.543690:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636581.543711:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225919232:0@lo:400: 00000100:00100000:3.0:1788636581.544844:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225919360 00000100:00100000:3.0:1788636581.544856:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225919360 00000100:00100000:3.0:1788636581.544894:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788636581.544902:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225919360:12345-0@lo:400: 00000100:00100000:3.0:1788636581.544973:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032406680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225919360:12345-0@lo:400: Request processed in 71us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636581.544980:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788636581.545166:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788636581.545252:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225918976:0@lo:400: 00010000:00080000:3.0:1788636581.550688:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf032405180 x1875521225919360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636581.550709:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225919360:0@lo:400: 00010000:00080000:1.0:1788636581.550839:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf032407100 x1875521225919488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636581.550850:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225919488:0@lo:400: 00010000:00010000:3.0:1788636582.296382:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636582.548996:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636582.549027:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225919744:0@lo:41: 00000100:00100000:1.0:1788636582.549112:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636582.549189:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225919744 00000100:00100000:1.0:1788636582.549198:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225919744 00000100:00100000:1.0:1788636582.549245:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788636582.549471:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225919744:12345-0@lo:41: 00000004:00000024:1.0:1788636582.549507:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788636582.549563:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225919744:12345-0@lo:41: Request processed in 95us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636582.549570:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788636582.549660:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225919744:0@lo:41: 00000020:01000004:1.0:1788636582.578126:0:9514:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788636582.578131:0:9514:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788636582.578132:0:9514:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788636582.582186:0:9514:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cf03a765800 00000020:01000004:1.0:1788636582.582206:0:9514:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788636582.582222:0:9514:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788636582.582234:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cf03a60b380) 00000020:00000080:1.0:1788636582.582260:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788636582.603608:0:9514:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788636582.603664:0:9514:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1788636582.618992:0:9514:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788636582.619229:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788636582.619246:0:9514:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788636582.619263:0:9514:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b741ef42e8380aa 00000020:01000004:2.0:1788636582.619272:0:9514:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788636582.619305:0:9514:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788636582.619310:0:9514:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788636582.619317:0:9514:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788636582.619349:0:9514:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788636582.619354:0:9514:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788636582.633211:0:9514:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788636582.633250:0:9514:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.126@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788636582.633254:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788636582.633256:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788636582.633261:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636582.633262:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636582.633263:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636582.633264:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636582.633265:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636582.633267:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636582.633268:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636582.633269:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636582.633270:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788636582.633274:0:9514:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788636582.633276:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788636582.633277:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788636582.633278:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636582.633279:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636582.633280:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636582.633281:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636582.633282:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636582.633283:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636582.633283:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636582.633284:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636582.633285:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788636582.633313:0:9514:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788636582.633332:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225919872:0@lo:253: 00000100:00100000:2.0:1788636582.633410:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.633583:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788636582.633775:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225919872 00000100:00100000:0.0:1788636582.633783:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225919872 00000100:00100000:0.0:1788636582.634181:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788636582.634193:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:9514:x1875521225919872:12345-0@lo:253: 20000000:01000000:0.0:1788636582.634225:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788636582.634229:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788636582.634234:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788636582.634237:0:6516:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788636582.634470:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636582.634666:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788636582.634690:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788636582.634709:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788636582.634716:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788636582.634729:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788636582.634743:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788636582.635537:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788636582.635557:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.126@tcp 20000000:01000000:0.0:1788636582.635559:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788636582.635646:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788636582.635734:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788636582.635754:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788636582.635761:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.126@tcp (null) (null) 00000040:00080000:0.0:1788636582.635773:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788636582.635779:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788636582.635947:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788636582.635968:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788636582.636059:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788636582.636072:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.126@tcp 20000000:01000000:0.0:1788636582.636074:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788636582.636087:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788636582.636092:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788636582.636104:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788636582.636109:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.126@tcp (null) (null) 00000040:00080000:0.0:1788636582.636121:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788636582.636127:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788636582.636140:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788636582.636156:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788636582.636551:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788636582.636564:0:6516:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.126@tcp 20000000:01000000:0.0:1788636582.636566:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.126@tcp (null) (null) (null) 00000040:00080000:0.0:1788636582.636593:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788636582.636608:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788636582.636626:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788636582.636632:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.126@tcp (null) (null) 00000040:00080000:0.0:1788636582.636645:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788636582.636651:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788636582.637033:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788636582.637052:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788636582.637070:0:6516:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788636582.637073:0:6516:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788636582.637077:0:6516:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788636582.637138:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788636582.637141:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788636582.638499:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788636582.638546:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788636582.638558:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788636582.638716:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788636582.638736:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1788636582.638750:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1788636582.638759:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788636582.638761:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788636582.642131:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788636582.642172:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788636582.642181:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788636582.642373:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788636582.642389:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788636582.642397:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788636582.642405:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788636582.642407:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788636582.642766:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788636582.643273:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788636582.643296:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788636582.643311:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1788636582.643320:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788636582.643322:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788636582.643766:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788636582.643788:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788636582.643802:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788636582.644172:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788636582.644191:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788636582.644215:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1788636582.644224:0:6516:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788636582.644226:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788636582.644516:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788636582.644537:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788636582.644563:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788636582.644717:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788636582.644735:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788636582.644750:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:2.0:1788636582.644766:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788636582.644788:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645077:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015990e00/0x5b741ef42e837fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837fa0 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645088:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e837fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837fca expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645094:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838010 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838009 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645101:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83802c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838025 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645107:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83804f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645113:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153f400/0x5b741ef42e838072 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83806b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645118:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83808e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645125:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645175:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83808e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645188:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83808e expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.645203:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02463b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920000:0@lo:104: 00000100:00100000:2.0:1788636582.645281:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788636582.645368:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153f400/0x5b741ef42e838072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83806b expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645377:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153f400/0x5b741ef42e838072 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83806b expref: 21 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.645386:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02462300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920128:0@lo:104: 00000100:00100000:2.0:1788636582.645406:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788636582.645490:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83804f expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.645497:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838056 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83804f expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.645504:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920256:0@lo:104: 00000100:00100000:2.0:1788636582.645525:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636582.645576:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225920000 00000100:00100000:1.0:1788636582.645585:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225920000 00000100:00100000:1.0:1788636582.645618:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225920128 00000100:00100000:1.0:1788636582.645621:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225920128 00000100:00100000:1.0:1788636582.645636:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788636582.645644:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6516:x1875521225920000:12345-0@lo:104: 00010000:00010000:1.0:1788636582.645656:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.645713:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636582.645718:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6516:x1875521225920000:12345-0@lo:104: Request processed in 76us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636582.645724:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788636582.645741:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788636582.645748:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6516:x1875521225920128:12345-0@lo:104: 00010000:00010000:1.0:1788636582.645755:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.645784:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788636582.645789:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6516:x1875521225920128:12345-0@lo:104: Request processed in 43us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636582.645795:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788636582.645882:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636582.645889:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.645896:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636582.645900:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.645909:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636582.645924:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636582.645929:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636582.645964:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.645970:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636582.645988:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.645995:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e83808e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838095 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.646006:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636582.646009:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.646015:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153e200 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636582.646017:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.646024:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636582.646030:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636582.646035:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636582.646067:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.646073:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636582.646088:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.646094:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e83806b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838072 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.646104:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636582.646106:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636582.646108:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636582.646114:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636582.646126:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225920384:0@lo:103: 00000100:00100000:0.0:1788636582.646159:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636582.646196:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225920512:0@lo:103: 00000100:00100000:0.0:1788636582.646218:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636582.646248:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225920384 00000100:00100000:0.0:1788636582.646252:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225920384 00010000:00010000:0.0:1788636582.646273:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838095 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83808e expref: 22 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636582.646291:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225920512 00000100:00100000:0.0:1788636582.646294:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225920512 00010000:00010000:0.0:1788636582.646305:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153f400/0x5b741ef42e838072 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83806b expref: 23 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636582.646317:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788636582.646323:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:3649:x1875521225920384:12345-0@lo:103: 00010000:00010000:0.0:1788636582.646342:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636582.646347:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838095 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83808e expref: 23 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.646356:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83808e expref: 23 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.646370:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636582.646395:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:3649:x1875521225920384:12345-0@lo:103: Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.646400:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788636582.646425:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636582.646431:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:3646:x1875521225920512:12345-0@lo:103: 00010000:00010000:0.0:1788636582.646437:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636582.646441:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153f400/0x5b741ef42e838072 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83806b expref: 22 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.646448:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153f400/0x5b741ef42e838072 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83806b expref: 22 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.646456:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636582.646479:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:3646:x1875521225920512:12345-0@lo:103: Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.646484:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636582.646518:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225920512:0@lo:103: 00000100:00100000:0.0:1788636582.646541:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225920384:0@lo:103: 00010000:00010000:2.0:1788636582.646674:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83802c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e838025 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.646682:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83802c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e838025 expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.646702:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02460380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920640:0@lo:104: 00000100:00100000:2.0:1788636582.646727:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788636582.646747:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e838009 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.646755:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838010 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e838009 expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.646762:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920768:0@lo:104: 00000100:00100000:2.0:1788636582.646779:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788636582.646796:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e837fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837fca expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.646830:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e837fd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837fca expref: 21 pid: 6516 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.646840:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920896:0@lo:104: 00000100:00100000:2.0:1788636582.646863:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788636582.646885:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015990e00/0x5b741ef42e837fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837fa0 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.646894:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015990e00/0x5b741ef42e837fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837fa0 expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.646901:0:6516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225921024:0@lo:104: 00000100:00100000:2.0:1788636582.646920:0:6516:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f03c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788636582.646932:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83808e expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.646951:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02463b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920000:0@lo:104: 00010000:00010000:2.0:1788636582.646962:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153f400/0x5b741ef42e838072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83806b expref: 20 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.646969:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02462300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920128:0@lo:104: 00000100:00100000:1.0:1788636582.647043:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788636582.647061:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636582.647072:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225920256 00000100:00100000:1.0:1788636582.647076:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225920256 00000100:00100000:1.0:1788636582.647094:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225920640 00000100:00100000:1.0:1788636582.647097:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225920640 00000100:00100000:1.0:1788636582.647117:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225920768 00000100:00100000:1.0:1788636582.647120:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225920768 00000100:00100000:1.0:1788636582.647128:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225920896 00000100:00100000:1.0:1788636582.647131:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225920896 00000100:00100000:1.0:1788636582.647138:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225921024 00000100:00100000:1.0:1788636582.647141:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225921024 00000100:00100000:1.0:1788636582.647150:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788636582.647156:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+7:6516:x1875521225920256:12345-0@lo:104: 00010000:00010000:1.0:1788636582.647164:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.647213:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636582.647219:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+7:6516:x1875521225920256:12345-0@lo:104: Request processed in 63us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636582.647225:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788636582.647237:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788636582.647243:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+6:6516:x1875521225920640:12345-0@lo:104: 00010000:00010000:1.0:1788636582.647250:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.647280:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788636582.647284:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+6:6516:x1875521225920640:12345-0@lo:104: Request processed in 43us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636582.647289:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788636582.647300:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788636582.647305:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:6516:x1875521225920768:12345-0@lo:104: 00010000:00010000:1.0:1788636582.647312:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.647348:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788636582.647353:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:6516:x1875521225920768:12345-0@lo:104: Request processed in 49us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636582.647358:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788636582.647370:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788636582.647375:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6516:x1875521225920896:12345-0@lo:104: 00010000:00010000:1.0:1788636582.647383:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.647405:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788636582.647409:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027be4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6516:x1875521225920896:12345-0@lo:104: Request processed in 36us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636582.647430:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788636582.647461:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788636582.647467:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6516:x1875521225921024:12345-0@lo:104: 00010000:00010000:1.0:1788636582.647473:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.647497:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788636582.647502:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6516:x1875521225921024:12345-0@lo:104: Request processed in 36us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636582.647507:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788636582.647572:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788636582.647579:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647592:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636582.647596:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647604:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636582.647610:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636582.647616:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636582.647651:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647658:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636582.647675:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647681:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e83804f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838056 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647691:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788636582.647694:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647699:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7c00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636582.647702:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647718:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636582.647724:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636582.647729:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636582.647743:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647749:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636582.647763:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647769:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7c00/0x5b741ef42e838025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83802c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647778:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788636582.647781:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647786:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ecf600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636582.647788:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647794:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636582.647799:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636582.647831:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636582.647845:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647850:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636582.647855:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647860:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e838009 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838010 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647869:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636582.647872:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647876:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015991a00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636582.647879:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647885:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636582.647891:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636582.647896:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636582.647907:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647913:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636582.647924:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647931:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015991a00/0x5b741ef42e837fca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837fd1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647940:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636582.647943:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647948:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153ec00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636582.647951:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647957:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636582.647962:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636582.647967:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636582.647978:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647984:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636582.647987:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.647993:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e837fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837fa7 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648005:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636582.648012:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636582.648014:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636582.648027:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225921280:0@lo:103: 00000100:00100000:0.0:1788636582.648074:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636582.648099:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636582.648106:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225921408:0@lo:103: 00000100:00100000:0.0:1788636582.648127:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636582.648153:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225921280 00000100:00100000:0.0:1788636582.648158:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225921280 00010000:00010000:0.0:1788636582.648175:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83802c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838025 expref: 20 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636582.648192:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225921408 00000100:00100000:0.0:1788636582.648194:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225921408 00010000:00010000:0.0:1788636582.648215:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838010 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838009 expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636582.648229:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636582.648236:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3648:x1875521225921280:12345-0@lo:103: 00010000:00010000:0.0:1788636582.648245:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636582.648249:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83802c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838025 expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648259:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83802c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e838025 expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648273:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636582.648303:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3648:x1875521225921280:12345-0@lo:103: Request processed in 68us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.648310:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636582.648330:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636582.648336:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:3648:x1875521225921408:12345-0@lo:103: 00010000:00010000:0.0:1788636582.648344:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636582.648349:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838010 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838009 expref: 20 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648357:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838010 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e838009 expref: 20 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648366:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636582.648389:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:3648:x1875521225921408:12345-0@lo:103: Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.648394:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636582.648457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225921152:0@lo:103: 00000100:00100000:0.0:1788636582.648478:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636582.648493:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225921664:0@lo:103: 00000100:00100000:0.0:1788636582.648511:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636582.648525:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636582.648530:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225921536:0@lo:103: 00000100:00100000:0.0:1788636582.648549:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636582.648565:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636582.648572:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225921152 00000100:00100000:0.0:1788636582.648575:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225921152 00010000:00010000:0.0:1788636582.648589:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838056 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83804f expref: 20 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636582.648602:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225921664 00000100:00100000:0.0:1788636582.648604:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225921664 00010000:00010000:0.0:1788636582.648613:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015990e00/0x5b741ef42e837fa7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837fa0 expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636582.648632:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225921536 00000100:00100000:0.0:1788636582.648634:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225921536 00010000:00010000:0.0:1788636582.648646:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e837fd1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837fca expref: 22 pid: 6516 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636582.648656:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636582.648662:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:3647:x1875521225921152:12345-0@lo:103: 00010000:00010000:0.0:1788636582.648669:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636582.648673:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838056 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83804f expref: 22 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648681:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838056 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83804f expref: 22 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648691:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636582.648717:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02711180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:3647:x1875521225921152:12345-0@lo:103: Request processed in 55us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.648723:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636582.648734:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636582.648740:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3647:x1875521225921664:12345-0@lo:103: 00010000:00010000:0.0:1788636582.648746:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636582.648750:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015990e00/0x5b741ef42e837fa7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837fa0 expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648758:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015990e00/0x5b741ef42e837fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837fa0 expref: 21 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648766:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636582.648794:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3647:x1875521225921664:12345-0@lo:103: Request processed in 55us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.648801:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636582.648835:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788636582.648842:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:3647:x1875521225921536:12345-0@lo:103: 00010000:00010000:0.0:1788636582.648849:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636582.648853:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e837fd1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837fca expref: 20 pid: 6516 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648861:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e837fd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837fca expref: 20 pid: 6516 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648872:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648880:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648892:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648899:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648906:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648913:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648918:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ecea00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636582.648928:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648937:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648945:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.648955:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636582.648975:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:3647:x1875521225921536:12345-0@lo:103: Request processed in 135us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.648981:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788636582.649017:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225921536:0@lo:103: 00000100:00100000:0.0:1788636582.649024:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225921152:0@lo:103: 00000100:00100000:0.0:1788636582.649030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225921664:0@lo:103: 00000100:00100000:0.0:1788636582.649050:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225921408:0@lo:103: 00000100:00100000:0.0:1788636582.649056:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225921280:0@lo:103: 00010000:00010000:0.0:1788636582.649067:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636582.649182:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83804f expref: 19 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.649193:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920256:0@lo:104: 00010000:00010000:2.0:1788636582.649203:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83802c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e838025 expref: 18 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.649210:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02460380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920640:0@lo:104: 00010000:00010000:2.0:1788636582.649219:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838010 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e838009 expref: 17 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.649227:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ef100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920768:0@lo:104: 00010000:00010000:2.0:1788636582.649235:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e837fd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837fca expref: 16 pid: 6516 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.649242:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225920896:0@lo:104: 00010000:00010000:2.0:1788636582.649251:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015990e00/0x5b741ef42e837fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837fa0 expref: 15 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.649258:0:6516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1875521225921024:0@lo:104: 00010000:00010000:2.0:1788636582.649281:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.649297:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.649304:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.649310:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ecea00/0x5b741ef42e8380b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788636582.649322:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788636582.655253:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:9514:x1875521225919872:12345-0@lo:253: Request processed in 21053us (21833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.655269:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788636582.655826:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225919872:0@lo:253: 10000000:01000000:2.0:1788636582.655843:0:9514:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788636582.655847:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636582.655849:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788636582.655850:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636582.655851:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788636582.655853:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636582.655854:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636582.655855:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636582.655857:0:9514:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788636582.655858:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636582.655860:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788636582.655881:0:9514:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf03a765800 from lustre-OST0001 10000000:01000000:2.0:1788636582.655910:0:9514:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788636582.655914:0:9514:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788636582.655922:0:9514:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf040b3b380 local copy 10000000:01000000:2.0:1788636582.655926:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788636582.655965:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.655976:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.656003:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.656024:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225921792:0@lo:101: 00000100:00100000:2.0:1788636582.656069:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.656110:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636582.658514:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225921792 00000100:00100000:1.0:1788636582.658533:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225921792 00000100:00100000:1.0:1788636582.658955:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788636582.658967:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+14:9514:x1875521225921792:12345-0@lo:101: 00010000:00010000:1.0:1788636582.659006:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636582.659031:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015991000/0x5b741ef42e8380bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8380b8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.659061:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015991000/0x5b741ef42e8380bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8380b8 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.659073:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015991000/0x5b741ef42e8380bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8380b8 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.659082:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015991000, rc 0) 00000100:00100000:1.0:1788636582.659951:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:9514:x1875521225921792:12345-0@lo:101: Request processed in 979us (3874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636582.659963:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788636582.660091:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225921792:0@lo:101: 00010000:00010000:2.0:1788636582.660116:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.660142:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.660283:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225921920:0@lo:501: 00000100:00100000:2.0:1788636582.660321:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.663391:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636582.663599:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225921920 00000100:00100000:3.0:1788636582.663613:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225921920 00000100:00100000:3.0:1788636582.663690:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788636582.663701:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:9514:x1875521225921920:12345-0@lo:501: 00000100:00100000:3.0:1788636582.663842:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:9514:x1875521225921920:12345-0@lo:501: Request processed in 143us (3520us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788636582.663850:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788636582.663944:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225921920:0@lo:501: 10000000:01000000:2.0:1788636582.663964:0:9514:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788636582.663991:0:9514:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788636582.664000:0:9514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.664011:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.664018:0:9514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.664062:0:9514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788636582.664089:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf03a765800 10000000:01000000:2.0:1788636582.664094:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788636582.664100:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788636582.664103:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788636582.664107:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788636582.664110:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788636582.664235:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.664244:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.664254:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.664272:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922048:0@lo:101: 00000100:00100000:2.0:1788636582.664304:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.664331:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225922048 00000100:00100000:2.0:1788636582.664335:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225922048 00000100:00100000:2.0:1788636582.664355:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788636582.664361:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:9514:x1875521225922048:12345-0@lo:101: 00010000:00010000:2.0:1788636582.664369:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636582.664380:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e8380cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8380c6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.664401:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e8380cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8380c6 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.664435:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e8380cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8380c6 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.664444:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015ecec00, rc 0) 00000100:00100000:2.0:1788636582.664470:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922048:12345-0@lo:101: Request processed in 109us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.664475:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788636582.664505:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.664518:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922048:0@lo:101: 00010000:00010000:2.0:1788636582.664530:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.664538:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.664598:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922176:0@lo:501: 00000100:00100000:2.0:1788636582.664623:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.664645:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225922176 00000100:00100000:2.0:1788636582.664649:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225922176 00000100:00100000:2.0:1788636582.664666:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788636582.664671:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922176:12345-0@lo:501: 00000100:00100000:2.0:1788636582.664754:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922176:12345-0@lo:501: Request processed in 82us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.664761:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788636582.664783:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.664795:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922176:0@lo:501: 00000100:00100000:2.0:1788636582.664861:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922304:0@lo:503: 00000100:00100000:2.0:1788636582.664898:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.664918:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225922304 00000100:00100000:2.0:1788636582.664922:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225922304 00000100:00100000:2.0:1788636582.664939:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788636582.664944:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922304:12345-0@lo:503: 00000100:00100000:2.0:1788636582.665010:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922304:12345-0@lo:503: Request processed in 65us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.665016:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788636582.665049:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.665062:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922304:0@lo:503: 00000040:00080000:2.0:1788636582.665328:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636582.665390:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922432:0@lo:502: 00000100:00100000:2.0:1788636582.665439:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.665462:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225922432 00000100:00100000:2.0:1788636582.665466:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225922432 00000100:00100000:2.0:1788636582.665484:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788636582.665489:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922432:12345-0@lo:502: 00000100:00100000:2.0:1788636582.665564:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922432:12345-0@lo:502: Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.665570:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788636582.665601:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.665615:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922432:0@lo:502: 00000040:00080000:2.0:1788636582.665884:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788636582.665910:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788636582.665923:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788636582.665947:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788636582.665961:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788636582.665974:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788636582.665994:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922560:0@lo:502: 00000100:00100000:2.0:1788636582.666029:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.666052:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225922560 00000100:00100000:2.0:1788636582.666057:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225922560 00000100:00100000:2.0:1788636582.666075:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788636582.666081:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922560:12345-0@lo:502: 00000100:00100000:2.0:1788636582.666142:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922560:12345-0@lo:502: Request processed in 60us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.666149:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788636582.666177:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.666189:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922560:0@lo:502: 00000040:00080000:2.0:1788636582.666222:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788636582.666230:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00010000:00010000:3.0:1788636582.666468:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636582.666476:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636582.666487:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ecfe00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636582.666499:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636582.666510:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636582.666517:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636582.666524:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636582.666548:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636582.666555:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636582.666573:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636582.666580:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfe00/0x5b741ef42e8380b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5b741ef42e8380bf expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636582.666591:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636582.666593:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636582.666594:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636582.668528:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225922688:0@lo:103: 00000100:00100000:2.0:1788636582.668608:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636582.669011:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225922688 00000100:00100000:3.0:1788636582.669019:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225922688 00000020:01000000:1.0:1788636582.669438:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788636582.669448:0:9525:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788636582.669455:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636582.669457:0:9525:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788636582.669463:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636582.669489:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cef02720000) 00000020:00000080:1.0:1788636582.669512:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788636582.669519:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788636582.669603:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf03a765800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788636582.669612:0:9525:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788636582.669619:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b741ef42e8380db 00000100:00100000:3.0:1788636582.672636:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636582.672653:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040992d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:3648:x1875521225922688:12345-0@lo:103: 00010000:00010000:3.0:1788636582.672671:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636582.672692:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015991000/0x5b741ef42e8380bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b741ef42e8380b8 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636582.672723:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636582.672827:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040992d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:3648:x1875521225922688:12345-0@lo:103: Request processed in 178us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636582.672835:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788636582.673335:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225922688:0@lo:103: 00010000:00010000:1.0:1788636582.674473:0:9525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1788636582.674900:0:9525:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788636582.678251:0:9525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788636582.678755:0:9525:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788636582.685759:0:9525:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788636582.685966:0:9525:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788636582.696880:0:9525:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788636582.698654:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788636582.698669:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636582.698676:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636582.698678:0:9525:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788636582.698694:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636582.698700:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636582.698701:0:9525:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788636582.698704:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788636582.698706:0:9525:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788636582.698730:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636582.698734:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636582.698735:0:9525:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788636582.698739:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788636582.703561:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788636582.703616:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788636582.703643:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636582.703657:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636582.703667:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf03a765800 from 1 10000000:01000000:3.0:1788636582.703678:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636582.703728:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636582.703738:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636582.703751:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636582.703778:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922816:0@lo:101: 00000100:00100000:3.0:1788636582.703874:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636582.703910:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02416d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.704091:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225922816 00000100:00100000:2.0:1788636582.704100:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225922816 00000100:00100000:2.0:1788636582.704152:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788636582.704163:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:9514:x1875521225922816:12345-0@lo:101: 00010000:00010000:2.0:1788636582.704178:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636582.704192:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015ecfc00/0x5b741ef42e8380e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8380e2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.704239:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015ecfc00/0x5b741ef42e8380e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8380e2 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.704250:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015ecfc00/0x5b741ef42e8380e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8380e2 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.704261:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015ecfc00, rc 0) 00000100:00100000:2.0:1788636582.704314:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922816:12345-0@lo:101: Request processed in 153us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.704320:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788636582.704403:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922816:0@lo:101: 00010000:00010000:2.0:1788636582.704429:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.704438:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.704555:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922944:0@lo:501: 00000100:00100000:2.0:1788636582.704581:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.704595:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636582.704889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225922944 00000100:00100000:0.0:1788636582.704895:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225922944 00000100:00100000:0.0:1788636582.704935:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788636582.704943:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922944:12345-0@lo:501: 00000100:00100000:0.0:1788636582.705080:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225922944:12345-0@lo:501: Request processed in 138us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.705087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788636582.705284:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225922944:0@lo:501: 00000100:00100000:2.0:1788636582.705316:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923072:0@lo:503: 00000100:00100000:2.0:1788636582.705369:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.705402:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636582.705452:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225923072 00000100:00100000:0.0:1788636582.705457:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225923072 00000100:00100000:0.0:1788636582.705487:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788636582.705494:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225923072:12345-0@lo:503: 00000100:00100000:0.0:1788636582.705582:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225923072:12345-0@lo:503: Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.705589:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788636582.706552:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923072:0@lo:503: 00000040:00080000:2.0:1788636582.706947:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636582.707032:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923200:0@lo:502: 00000100:00100000:2.0:1788636582.707084:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.707120:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636582.707628:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225923200 00000100:00100000:0.0:1788636582.707637:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225923200 00000100:00100000:0.0:1788636582.707691:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788636582.707708:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225923200:12345-0@lo:502: 00000100:00100000:0.0:1788636582.707861:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225923200:12345-0@lo:502: Request processed in 153us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.707870:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788636582.708625:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923200:0@lo:502: 00000040:00080000:2.0:1788636582.709900:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788636582.709952:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788636582.710003:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923328:0@lo:502: 00000100:00100000:2.0:1788636582.710096:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.710156:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225923328 00000100:00100000:2.0:1788636582.710166:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225923328 00000100:00100000:2.0:1788636582.710252:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788636582.710264:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225923328:12345-0@lo:502: 00000100:00100000:2.0:1788636582.710399:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225923328:12345-0@lo:502: Request processed in 136us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.710408:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788636582.710475:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.710494:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923328:0@lo:502: 00000040:00080000:2.0:1788636582.710547:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788636582.710555:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788636582.710859:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636582.710868:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636582.710871:0:9529:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788636582.710877:0:9529:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf03a765800 00000020:00000080:2.0:1788636582.710879:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788636582.710891:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636582.710894:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636582.710896:0:9529:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788636582.710898:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788636582.710938:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788636582.710961:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636582.710979:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.710990:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636582.711035:0:9514:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788636582.711038:0:9514:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf03a765800 10000000:01000000:2.0:1788636582.711041:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf03a765800 10000000:01000000:2.0:1788636582.711046:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788636582.711052:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf03a765800 from 1 10000000:01000000:2.0:1788636582.711055:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788636582.711090:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.711099:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.711109:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.711124:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923456:0@lo:101: 00000100:00100000:2.0:1788636582.711162:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.711182:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.711209:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225923456 00000100:00100000:2.0:1788636582.711214:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225923456 00000100:00100000:2.0:1788636582.711243:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788636582.711250:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9514:x1875521225923456:12345-0@lo:101: 00010000:00010000:2.0:1788636582.711272:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636582.711288:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015ecfe00/0x5b741ef42e8380f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8380f0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.711309:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015ecfe00/0x5b741ef42e8380f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8380f0 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.711321:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015ecfe00/0x5b741ef42e8380f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8380f0 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.711329:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015ecfe00, rc 0) 00000100:00100000:2.0:1788636582.711360:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225923456:12345-0@lo:101: Request processed in 110us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.711366:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788636582.711403:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923456:0@lo:101: 00010000:00010000:2.0:1788636582.711427:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.711437:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636582.711502:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923584:0@lo:501: 00000100:00100000:2.0:1788636582.711528:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.711551:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225923584 00000100:00100000:2.0:1788636582.711555:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225923584 00000100:00100000:2.0:1788636582.711578:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788636582.711584:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225923584:12345-0@lo:501: 00000100:00100000:2.0:1788636582.711675:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225923584:12345-0@lo:501: Request processed in 90us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.711689:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788636582.711714:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.711725:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923584:0@lo:501: 00000100:00100000:2.0:1788636582.711749:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923712:0@lo:503: 00000100:00100000:2.0:1788636582.711787:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.711828:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225923712 00000100:00100000:2.0:1788636582.711832:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225923712 00000100:00100000:2.0:1788636582.711853:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788636582.711859:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225923712:12345-0@lo:503: 00000100:00100000:2.0:1788636582.711925:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225923712:12345-0@lo:503: Request processed in 65us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.711932:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788636582.711960:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.711970:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923712:0@lo:503: 00000040:00080000:2.0:1788636582.712158:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636582.712215:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923840:0@lo:502: 00000100:00100000:2.0:1788636582.712252:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.712272:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225923840 00000100:00100000:2.0:1788636582.712276:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225923840 00000100:00100000:2.0:1788636582.712298:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788636582.712306:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225923840:12345-0@lo:502: 00000100:00100000:2.0:1788636582.712389:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225923840:12345-0@lo:502: Request processed in 84us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.712396:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788636582.717160:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026932d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636582.717223:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923840:0@lo:502: 00000040:00080000:3.0:1788636582.717546:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788636582.717580:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788636582.717595:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788636582.717608:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788636582.717621:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788636582.717634:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788636582.717645:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788636582.717661:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788636582.717831:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788636582.717848:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788636582.717861:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788636582.717874:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788636582.717888:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788636582.717900:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788636582.717912:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788636582.717925:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788636582.717939:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788636582.717951:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788636582.717962:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788636582.717975:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788636582.717988:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788636582.718001:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788636582.718013:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788636582.718026:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788636582.718039:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788636582.718051:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788636582.718063:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788636582.718075:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788636582.718086:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788636582.718098:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788636582.718109:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788636582.718121:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788636582.718145:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788636582.718157:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788636582.718170:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788636582.718181:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788636582.718192:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788636582.718205:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788636582.718219:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788636582.718233:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788636582.718245:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788636582.718259:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788636582.718270:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788636582.718282:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788636582.718295:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788636582.718307:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788636582.718349:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923968:0@lo:502: 00000100:00100000:3.0:1788636582.718442:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636582.718484:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02416780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636582.719633:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225923968 00000100:00100000:0.0:1788636582.719644:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225923968 00000100:00100000:0.0:1788636582.719904:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788636582.719914:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225923968:12345-0@lo:502: 00000100:00100000:0.0:1788636582.720284:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225923968:12345-0@lo:502: Request processed in 371us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.720292:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788636582.725043:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225923968:0@lo:502: 00000040:00080000:0.0:1788636582.725287:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788636582.725304:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788636582.726144:0:9530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788636582.726162:0:9530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cf041983380) 00000020:00000080:3.0:1788636582.726190:0:9530:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788636582.726301:0:9530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf03a765800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788636582.726305:0:9530:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf03a765800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788636582.726308:0:9530:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf03a765800 3 00010000:00080000:3.0:1788636582.726340:0:9530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef03101800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.126@tcp at head 00010000:00010000:3.0:1788636582.733307:0:9530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788636582.735005:0:9530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788636582.735074:0:9530:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788636582.735091:0:9530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5b741ef42e838105 00000100:00080000:3.0:1788636582.735105:0:9530:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636582.735112:0:9530:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cef03101800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636582.735160:0:9530:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf032405180 x1875521225924096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636582.735218:0:9530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788636582.735445:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521225924096:0@lo:38: 00000100:00100000:1.0:1788636582.735551:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.735962:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225924608:0@lo:400: 00000100:00100000:2.0:1788636582.735998:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.736026:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788636582.736032:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225924224:0@lo:400: 00000100:00100000:2.0:1788636582.736068:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.736090:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225924736:0@lo:400: 00000100:00100000:2.0:1788636582.736113:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.736132:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225924352:0@lo:400: 00000100:00100000:2.0:1788636582.736156:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.736169:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225924864:0@lo:400: 00000100:00100000:2.0:1788636582.736189:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.736210:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788636582.736214:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225924480:0@lo:400: 00000100:00100000:2.0:1788636582.736237:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.736256:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225924992:0@lo:400: 00000100:00100000:2.0:1788636582.736275:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.736310:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225924096 00000100:00100000:2.0:1788636582.736319:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225924096 00000100:00100000:2.0:1788636582.736346:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225924608 00000100:00100000:2.0:1788636582.736348:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225924608 00000100:00100000:2.0:1788636582.736371:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225924224 00000100:00100000:2.0:1788636582.736374:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225924224 00000100:00100000:2.0:1788636582.736383:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225924736 00000100:00100000:2.0:1788636582.736385:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225924736 00000100:00100000:2.0:1788636582.736395:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225924352 00000100:00100000:2.0:1788636582.736398:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225924352 00000100:00100000:2.0:1788636582.736424:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788636582.736434:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225924608:12345-0@lo:400: 00000100:00100000:2.0:1788636582.736488:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225924608:12345-0@lo:400: Request processed in 55us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.736501:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788636582.736520:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788636582.736526:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225924224:12345-0@lo:400: 00000100:00100000:2.0:1788636582.736554:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225924224:12345-0@lo:400: Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.736560:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788636582.736571:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636582.736576:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225924736:12345-0@lo:400: 00000100:00100000:2.0:1788636582.736600:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225924736:12345-0@lo:400: Request processed in 25us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.736606:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636582.736616:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636582.736623:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225924352:12345-0@lo:400: 00000100:00100000:2.0:1788636582.736654:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225924352:12345-0@lo:400: Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.736659:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636582.736673:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636582.736677:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875521225924096:12345-0@lo:38: 00010000:00080000:2.0:1788636582.736702:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1788636582.736748:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5b741ef42e83810c 00000004:00100000:2.0:1788636582.736764:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788636582.736796:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc67800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636582.736856:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875521225924096:12345-0@lo:38: Request processed in 178us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.736863:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636582.736890:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225924864 00000100:00100000:2.0:1788636582.736894:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225924864 00000100:00100000:2.0:1788636582.736913:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225924992 00000100:00100000:2.0:1788636582.736915:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225924992 00000100:00100000:2.0:1788636582.737268:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636582.737276:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225924864:12345-0@lo:400: 00000100:00100000:2.0:1788636582.737312:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225924864:12345-0@lo:400: Request processed in 38us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.737318:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636582.737329:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788636582.737335:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225924992:12345-0@lo:400: 00000100:00100000:2.0:1788636582.737358:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225924992:12345-0@lo:400: Request processed in 23us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.737363:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788636582.737382:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225924480 00000100:00100000:2.0:1788636582.737386:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225924480 00000100:00100000:2.0:1788636582.737428:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788636582.737436:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225924480:12345-0@lo:400: 00000100:00100000:2.0:1788636582.737470:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225924480:12345-0@lo:400: Request processed in 33us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.737476:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788636582.737536:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225924480:0@lo:400: 00010000:00080000:2.0:1788636582.737550:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040991180 x1875521225924992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636582.737559:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225924992:0@lo:400: 00010000:00080000:2.0:1788636582.737569:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040992300 x1875521225924352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636582.737589:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225924352:0@lo:400: 00010000:00080000:2.0:1788636582.737600:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040993800 x1875521225924864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636582.737608:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225924864:0@lo:400: 00010000:00080000:2.0:1788636582.737638:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040990380 x1875521225924224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636582.737646:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225924224:0@lo:400: 00010000:00080000:2.0:1788636582.737654:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040991c00 x1875521225924736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636582.737672:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225924736:0@lo:400: 00010000:00080000:2.0:1788636582.737683:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf040991880 x1875521225924608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636582.737691:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225924608:0@lo:400: 00010000:00080000:2.0:1788636582.737719:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf032405180 x1875521225924096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636582.737727:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788636582.737733:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788636582.737740:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788636582.737744:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788636582.737746:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788636582.737751:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521225924096:0@lo:38: 00000020:01000004:2.0:1788636582.738205:0:9530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788636582.738222:0:9530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9cef019d3380) 00000020:00000080:2.0:1788636582.738242:0:9530:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1788636582.738327:0:9530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf03a765800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788636582.738331:0:9530:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf03a765800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788636582.738334:0:9530:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf03a765800 3 00010000:00080000:2.0:1788636582.738360:0:9530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf03fc66000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.126@tcp at head 00010000:00010000:2.0:1788636582.746566:0:9530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788636582.747926:0:9530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788636582.747976:0:9530:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788636582.747990:0:9530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5b741ef42e83811a 00000100:00080000:2.0:1788636582.748002:0:9530:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788636582.748008:0:9530:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cf03fc66000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636582.748042:0:9530:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef03244e00 x1875521225925120/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788636582.748078:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875521225925120:0@lo:38: 00000100:00100000:2.0:1788636582.748143:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.748203:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225925120 00000100:00100000:2.0:1788636582.748210:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225925120 00000100:00100000:2.0:1788636582.748240:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636582.748248:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875521225925120:12345-0@lo:38: 00000100:00100000:1.0:1788636582.748401:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9531:1875521225925248:0@lo:901: 00000100:00100000:1.0:1788636582.748452:0:9531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636582.748487:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225925248 00000100:00100000:1.0:1788636582.748490:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225925248 00000100:00100000:1.0:1788636582.748552:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788636582.748564:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9531:x1875521225925248:12345-0@lo:901: 00000100:00100000:1.0:1788636582.748662:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9531:x1875521225925248:12345-0@lo:901: Request processed in 99us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636582.748669:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788636582.748697:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636582.748714:0:9531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aa2dcc0 going to sleep for 11 seconds 00010000:00080000:1.0:1788636582.748738:0:9531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03aba4e00 x1875521225925248/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788636598 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636582.748751:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9531:1875521225925248:0@lo:901: 00010000:00080000:2.0:1788636582.749058:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1788636582.749100:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5b741ef42e838121 00000004:00100000:2.0:1788636582.749115:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788636582.749143:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9cef033a4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636582.749187:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875521225925120:12345-0@lo:38: Request processed in 939us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.749194:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788636582.754529:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef03244e00 x1875521225925120/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636582.754547:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788636582.754558:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788636582.754568:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788636582.754575:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788636582.754578:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc66000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788636582.754586:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875521225925120:0@lo:38: 00000100:00080000:2.0:1788636582.754619:0:9530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1788636582.755555:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1788636582.757854:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1788636582.757901:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788636582.757926:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.757939:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788636582.757990:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788636582.757992:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788636582.757994:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636582.757995:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636582.757997:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636582.757998:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636582.758003:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788636582.758005:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788636582.758006:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788636582.758007:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636582.758009:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788636582.758012:0:9514:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788636582.758015:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788636582.758016:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788636582.758018:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636582.758019:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636582.758020:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636582.758021:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636582.758022:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788636582.758023:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788636582.758024:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788636582.758025:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636582.758026:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788636582.758054:0:9514:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788636582.758072:0:9514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225925376:0@lo:253: 00000100:00100000:1.0:1788636582.758145:0:9514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636582.758184:0:9514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aa2d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.758276:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225925376 00000100:00100000:2.0:1788636582.758285:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225925376 00000100:00100000:2.0:1788636582.758334:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788636582.758344:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225925376:12345-0@lo:253: 20000000:01000000:2.0:1788636582.758371:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788636582.758388:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788636582.773297:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788636582.773327:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788636582.773543:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788636582.773552:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788636582.773585:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.773613:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e83801e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838017 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.773621:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838064 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83805d expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.773634:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.773697:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83805d expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.773740:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838064 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83805d expref: 17 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636582.773766:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225925504:0@lo:104: 00000100:00100000:1.0:1788636582.773903:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636582.773974:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e83801e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e838017 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636582.773986:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e83801e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e838017 expref: 17 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636582.774001:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225925632:0@lo:104: 00000100:00100000:1.0:1788636582.774034:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636582.774066:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf007725300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636582.774673:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225925504 00000100:00100000:2.0:1788636582.774686:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225925504 00000100:00100000:2.0:1788636582.774744:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225925632 00000100:00100000:2.0:1788636582.774747:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225925632 00000100:00100000:2.0:1788636582.774773:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788636582.774788:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6537:x1875521225925504:12345-0@lo:104: 00010000:00010000:2.0:1788636582.774802:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.774901:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636582.774907:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:6537:x1875521225925504:12345-0@lo:104: Request processed in 127us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.774925:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788636582.774947:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788636582.774952:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6537:x1875521225925632:12345-0@lo:104: 00010000:00010000:2.0:1788636582.774960:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.774994:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788636582.774998:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:6537:x1875521225925632:12345-0@lo:104: Request processed in 46us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636582.775003:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788636582.775016:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788636582.775021:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.775027:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:2.0:1788636582.775031:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.775038:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636582.775045:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636582.775050:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636582.775077:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.775083:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636582.775105:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.775113:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e83805d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838064 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.775126:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636582.775129:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.775134:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:2.0:1788636582.775137:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.775143:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636582.775150:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636582.775154:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636582.775168:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.775174:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636582.775178:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636582.775185:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838017 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83801e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.775278:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636582.775387:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636582.775394:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636582.775399:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636582.775444:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225925760:0@lo:103: 00000100:00100000:2.0:1788636582.775494:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636582.775922:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636582.775930:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225925888:0@lo:103: 00000100:00100000:2.0:1788636582.775964:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636582.776860:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225925504:0@lo:104: 00000100:00100000:1.0:1788636582.776874:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1875521225925632:0@lo:104: 00010000:00010000:1.0:1788636582.776895:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636582.777115:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9514:x1875521225925376:12345-0@lo:253: Request processed in 18770us (18968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636582.777125:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788636582.777265:0:9514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9514:1875521225925376:0@lo:253: 10000000:01000000:1.0:1788636582.777276:0:9514:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788636582.777279:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788636582.777281:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788636582.777282:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636582.777283:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636582.777284:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636582.777286:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636582.777287:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788636582.777298:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788636582.777299:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788636582.777301:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636582.777303:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788636582.777315:0:9514:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788636582.784686:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225925760 00000100:00100000:0.0:1788636582.784701:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225925760 00010000:00010000:0.0:1788636582.784754:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838064 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83805d expref: 17 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636582.784826:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225925888 00000100:00100000:0.0:1788636582.784830:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225925888 00010000:00010000:0.0:1788636582.784844:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e83801e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838017 expref: 18 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636582.784861:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636582.784870:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:3648:x1875521225925760:12345-0@lo:103: 00010000:00010000:0.0:1788636582.784891:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636582.784897:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838064 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83805d expref: 18 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.784930:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83805d expref: 18 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.784949:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838064 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83805d expref: 18 pid: 6513 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.784964:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636582.785053:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:3648:x1875521225925760:12345-0@lo:103: Request processed in 185us (9563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.785060:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636582.785077:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636582.785082:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:3648:x1875521225925888:12345-0@lo:103: 00010000:00010000:0.0:1788636582.785091:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636582.785095:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e83801e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838017 expref: 16 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785103:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e83801e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e838017 expref: 16 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785112:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e83801e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e838017 expref: 16 pid: 6514 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785124:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785131:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788636582.785146:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011595539s 00010000:00010000:0.0:1788636582.785157:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785164:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785169:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785175:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785181:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015991000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636582.785185:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785193:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785211:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785221:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636582.785246:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:3648:x1875521225925888:12345-0@lo:103: Request processed in 164us (9282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636582.785252:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788636582.785291:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785300:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636582.785316:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015991000/0x5b741ef42e838128 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636582.785920:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225925888:0@lo:103: 00000100:00100000:3.0:1788636582.785933:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225925760:0@lo:103: 00080000:10000000:1.0:1788636582.787271:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788636582.787445:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788636582.788051:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788636582.788215:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788636582.790783:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788636582.798734:0:9514:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788636582.801598:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788636582.821109:0:9514:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788636582.821122:0:9514:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788636582.821159:0:9514:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788636582.821202:0:9514:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788636582.821218:0:9514:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788636582.821240:0:9514:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788636582.824072:0:9514:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788636582.824263:0:9514:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788636583.320915:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788636583.952736:0:9586:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788636583.953195:0:9586:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788636584.342775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636585.365299:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636586.390959:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636586.646162:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225926016:0@lo:13: 00000100:00100000:3.0:1788636586.646240:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636586.646312:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636586.646319:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225926144:0@lo:13: 00000100:00100000:3.0:1788636586.646377:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636586.646424:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225926016 00000100:00100000:3.0:1788636586.646432:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225926016 00000100:00100000:3.0:1788636586.646479:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225926144 00000100:00100000:3.0:1788636586.646482:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225926144 00000100:00100000:3.0:1788636586.646505:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636586.646513:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225926016:12345-0@lo:13: 00002000:00000024:3.0:1788636586.646545:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636586.646588:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225926016:12345-0@lo:13: Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636586.646594:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636586.646619:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636586.646625:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225926144:12345-0@lo:13: 00002000:00000024:3.0:1788636586.646635:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636586.646659:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225926144:12345-0@lo:13: Request processed in 35us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636586.646664:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788636586.646694:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636586.646722:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf032405180 x1875521225926144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636586.646741:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032405180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225926144:0@lo:13: 00010000:00080000:3.0:1788636586.646752:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf032407100 x1875521225926016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636602 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636586.646764:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032407100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225926016:0@lo:13: 00000100:00100000:2.0:1788636586.647247:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636586.647260:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225926272:0@lo:41: 00000100:00100000:2.0:1788636586.647300:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636586.650859:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225926272 00000100:00100000:1.0:1788636586.650876:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225926272 00000100:00100000:1.0:1788636586.650949:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788636586.650961:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225926272:12345-0@lo:41: 00000004:00000024:1.0:1788636586.651006:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788636586.651873:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225926272:12345-0@lo:41: Request processed in 908us (4566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636586.651884:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788636586.652049:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225926272:0@lo:41: 00010000:00010000:0.0:1788636587.416049:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636587.672430:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225926400:0@lo:41: 00000100:00100000:0.0:1788636587.672514:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636587.673588:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225926400 00000100:00100000:2.0:1788636587.673601:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225926400 00000100:00100000:2.0:1788636587.673681:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788636587.673793:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225926400:12345-0@lo:41: 00000004:00000024:2.0:1788636587.673864:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788636587.674333:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225926400:12345-0@lo:41: Request processed in 543us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636587.674342:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788636587.679553:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225926400:0@lo:41: 00000100:00100000:3.0:1788636588.185573:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225926656:0@lo:400: 00000100:00100000:3.0:1788636588.185662:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.185721:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521225927168:0@lo:400: 00000100:00100000:3.0:1788636588.185745:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.185771:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521225927680:0@lo:400: 00000100:00100000:3.0:1788636588.185798:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.185858:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788636588.185865:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225926528:0@lo:400: 00000100:00100000:3.0:1788636588.185898:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.185922:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225927040:0@lo:400: 00000100:00100000:3.0:1788636588.185943:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.185954:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225927552:0@lo:400: 00000100:00100000:3.0:1788636588.185990:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.186010:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225926784:0@lo:400: 00000100:00100000:3.0:1788636588.186031:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.186041:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225927296:0@lo:400: 00000100:00100000:3.0:1788636588.186061:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.186079:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788636588.186084:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225926912:0@lo:400: 00000100:00100000:3.0:1788636588.186105:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.186121:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225927424:0@lo:400: 00000100:00100000:3.0:1788636588.186140:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.186176:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225926656 00000100:00100000:3.0:1788636588.186185:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225926656 00000100:00100000:3.0:1788636588.186236:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225927168 00000100:00100000:3.0:1788636588.186239:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225927168 00000100:00100000:3.0:1788636588.186262:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225927680 00000100:00100000:3.0:1788636588.186265:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225927680 00000100:00100000:3.0:1788636588.186276:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225927040 00000100:00100000:3.0:1788636588.186278:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225927040 00000100:00100000:3.0:1788636588.186303:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225927552 00000100:00100000:3.0:1788636588.186307:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225927552 00000100:00100000:3.0:1788636588.186319:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225926784 00000100:00100000:3.0:1788636588.186321:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225926784 00000100:00100000:3.0:1788636588.186334:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788636588.186343:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225926656:12345-0@lo:400: 00000100:00100000:3.0:1788636588.186394:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225926656:12345-0@lo:400: Request processed in 51us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.186401:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788636588.186419:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788636588.186425:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521225927168:12345-0@lo:400: 00000100:00100000:3.0:1788636588.186459:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521225927168:12345-0@lo:400: Request processed in 35us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.186466:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788636588.186477:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788636588.186484:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521225927680:12345-0@lo:400: 00000100:00100000:3.0:1788636588.186508:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521225927680:12345-0@lo:400: Request processed in 25us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.186515:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788636588.186526:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788636588.186532:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225927040:12345-0@lo:400: 00000100:00100000:3.0:1788636588.186556:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225927040:12345-0@lo:400: Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.186562:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788636588.186574:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788636588.186579:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225927552:12345-0@lo:400: 00000100:00100000:3.0:1788636588.186603:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225927552:12345-0@lo:400: Request processed in 24us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.186609:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788636588.186619:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788636588.186626:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225926784:12345-0@lo:400: 00000100:00100000:3.0:1788636588.186654:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225926784:12345-0@lo:400: Request processed in 29us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.186660:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788636588.186685:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225926528 00000100:00100000:3.0:1788636588.186688:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225926528 00000100:00100000:3.0:1788636588.186711:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788636588.186724:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:3647:x1875521225926528:12345-0@lo:400: 00000100:00100000:3.0:1788636588.186751:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:3647:x1875521225926528:12345-0@lo:400: Request processed in 28us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.186757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788636588.186785:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225927296 00000100:00100000:3.0:1788636588.186788:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225927296 00000100:00100000:3.0:1788636588.186842:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225927424 00000100:00100000:3.0:1788636588.186846:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225927424 00000100:00100000:3.0:1788636588.186861:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788636588.186867:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225927296:12345-0@lo:400: 00000100:00100000:3.0:1788636588.186897:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225927296:12345-0@lo:400: Request processed in 29us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.186902:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788636588.186912:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636588.186918:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225927424:12345-0@lo:400: 00000100:00100000:3.0:1788636588.186940:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225927424:12345-0@lo:400: Request processed in 24us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.186946:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636588.186964:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225926912 00000100:00100000:3.0:1788636588.186967:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225926912 00000100:00100000:3.0:1788636588.186995:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788636588.187001:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225926912:12345-0@lo:400: 00000100:00100000:3.0:1788636588.187030:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225926912:12345-0@lo:400: Request processed in 30us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.187036:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788636588.187057:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636588.187062:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636588.187070:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636588.187120:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225926912:0@lo:400: 00010000:00080000:3.0:1788636588.187137:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320d180 x1875521225927424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.187148:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225927424:0@lo:400: 00010000:00080000:3.0:1788636588.187158:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320f100 x1875521225926784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.187166:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225926784:0@lo:400: 00010000:00080000:3.0:1788636588.187175:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320d880 x1875521225927296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.187183:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225927296:0@lo:400: 00000100:00100000:3.0:1788636588.187220:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225926528:0@lo:400: 00010000:00080000:3.0:1788636588.187231:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320c000 x1875521225927040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.187239:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225927040:0@lo:400: 00010000:00080000:3.0:1788636588.187250:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320fb80 x1875521225927552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.187257:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225927552:0@lo:400: 00010000:00080000:3.0:1788636588.187268:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320e680 x1875521225926656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.187275:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225926656:0@lo:400: 00010000:00080000:3.0:1788636588.187297:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320f800 x1875521225927168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.187312:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521225927168:0@lo:400: 00010000:00080000:3.0:1788636588.187325:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320f480 x1875521225927680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.187332:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521225927680:0@lo:400: 00010000:00010000:3.0:1788636588.441777:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788636588.693465:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788636588.693474:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00f1a3000 from 39 10000000:01000000:2.0:1788636588.693479:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788636588.693529:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.693540:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.693550:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636588.693574:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225927808:0@lo:101: 00000100:00100000:2.0:1788636588.693648:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.693708:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf007725600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.693979:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225927808 00000100:00100000:3.0:1788636588.693988:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225927808 00000100:00100000:3.0:1788636588.694046:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788636588.694054:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225927808:12345-0@lo:101: 00010000:00010000:3.0:1788636588.694069:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636588.694084:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83812f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.694109:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83812f expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.694120:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83812f expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.694128:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e000, rc 0) 00000100:00100000:3.0:1788636588.694171:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225927808:12345-0@lo:101: Request processed in 116us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.694178:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788636588.694240:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225927808:0@lo:101: 00010000:00010000:3.0:1788636588.694257:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.694299:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636588.694366:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225927936:0@lo:501: 00000100:00100000:3.0:1788636588.694750:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.694774:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.694791:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225927936 00000100:00100000:3.0:1788636588.694796:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225927936 00000100:00100000:3.0:1788636588.696139:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788636588.696158:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225927936:12345-0@lo:501: 00000100:00100000:3.0:1788636588.696983:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225927936:12345-0@lo:501: Request processed in 827us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.696994:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788636588.698178:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225927936:0@lo:501: 00000100:00100000:2.0:1788636588.698255:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225928064:0@lo:503: 00000100:00100000:2.0:1788636588.698340:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.698381:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf007725600 going to sleep for 11 seconds 00000100:00100000:2.0:1788636588.698411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225928064 00000100:00100000:2.0:1788636588.698417:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225928064 00000100:00100000:2.0:1788636588.698463:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788636588.698472:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225928064:12345-0@lo:503: 00000100:00100000:2.0:1788636588.698604:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225928064:12345-0@lo:503: Request processed in 132us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636588.698610:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788636588.698657:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225928064:0@lo:503: 00000100:00100000:2.0:1788636588.701622:0:9832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9832:1875521225928192:0@lo:502: 00000100:00100000:2.0:1788636588.701724:0:9832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.701781:0:9832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0077259c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636588.702121:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225928192 00000100:00100000:2.0:1788636588.702128:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225928192 00000100:00100000:2.0:1788636588.702170:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788636588.702180:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9832:x1875521225928192:12345-0@lo:502: 00000100:00100000:2.0:1788636588.702326:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9832:x1875521225928192:12345-0@lo:502: Request processed in 147us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636588.702333:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788636588.702392:0:9832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9832:1875521225928192:0@lo:502: 00000100:00100000:2.0:1788636588.702440:0:9832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9832:1875521225928320:0@lo:502: 00000100:00100000:2.0:1788636588.702472:0:9832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.702493:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225928320 00000100:00100000:2.0:1788636588.702496:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225928320 00000100:00100000:2.0:1788636588.702517:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788636588.702523:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9832:x1875521225928320:12345-0@lo:502: 00000100:00100000:2.0:1788636588.702577:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:9832:x1875521225928320:12345-0@lo:502: Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636588.702584:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788636588.702615:0:9832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636588.702627:0:9832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9832:1875521225928320:0@lo:502: 00000040:00080000:2.0:1788636588.702644:0:9832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788636588.702719:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788636588.703283:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788636588.703299:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.703325:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636588.703336:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788636588.703340:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788636588.703344:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788636588.703383:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.703394:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.703404:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636588.703419:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225928448:0@lo:101: 00000100:00100000:2.0:1788636588.703454:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.703479:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636588.703494:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225928448 00000100:00100000:2.0:1788636588.703498:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225928448 00000100:00100000:2.0:1788636588.703526:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788636588.703533:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225928448:12345-0@lo:101: 00010000:00010000:2.0:1788636588.703543:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636588.703559:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015ecf000/0x5b741ef42e838144 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83813d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.703590:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015ecf000/0x5b741ef42e838144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83813d expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.703615:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015ecf000/0x5b741ef42e838144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83813d expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.703627:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015ecf000, rc 0) 00000100:00100000:2.0:1788636588.703661:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225928448:12345-0@lo:101: Request processed in 128us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636588.703668:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788636588.703708:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225928448:0@lo:101: 00010000:00010000:2.0:1788636588.703722:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.705041:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636588.705141:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225928576:0@lo:501: 00000100:00100000:2.0:1788636588.705208:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.705254:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788636588.705481:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225928576 00000100:00100000:1.0:1788636588.705487:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225928576 00000100:00100000:1.0:1788636588.705529:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788636588.705538:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225928576:12345-0@lo:501: 00000100:00100000:1.0:1788636588.705685:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225928576:12345-0@lo:501: Request processed in 148us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636588.705692:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788636588.705770:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225928576:0@lo:501: 00000100:00100000:3.0:1788636588.705800:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225928704:0@lo:503: 00000100:00100000:3.0:1788636588.706048:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.706074:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636588.706114:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225928704 00000100:00100000:1.0:1788636588.706118:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225928704 00000100:00100000:1.0:1788636588.706150:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788636588.706156:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225928704:12345-0@lo:503: 00000100:00100000:1.0:1788636588.706243:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225928704:12345-0@lo:503: Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636588.706250:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788636588.706329:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225928704:0@lo:503: 00000100:00100000:3.0:1788636588.706652:0:9833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9833:1875521225928832:0@lo:502: 00000100:00100000:3.0:1788636588.706689:0:9833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.706708:0:9833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636588.707056:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225928832 00000100:00100000:1.0:1788636588.707061:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225928832 00000100:00100000:1.0:1788636588.707096:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788636588.707104:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9833:x1875521225928832:12345-0@lo:502: 00000100:00100000:1.0:1788636588.707184:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9833:x1875521225928832:12345-0@lo:502: Request processed in 81us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636588.707191:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788636588.707230:0:9833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9833:1875521225928832:0@lo:502: 00000020:01000000:1.0:1788636588.707255:0:9833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636588.707263:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636588.707266:0:9833:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788636588.707271:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788636588.707273:0:9833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788636588.707299:0:9833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9833:1875521225928960:0@lo:502: 00000100:00100000:1.0:1788636588.707327:0:9833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636588.707344:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225928960 00000100:00100000:1.0:1788636588.707348:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225928960 00000100:00100000:1.0:1788636588.707361:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788636588.707365:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9833:x1875521225928960:12345-0@lo:502: 00000100:00100000:1.0:1788636588.707421:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:9833:x1875521225928960:12345-0@lo:502: Request processed in 54us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636588.707427:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788636588.707452:0:9833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636588.707463:0:9833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9833:1875521225928960:0@lo:502: 00000020:01000000:1.0:1788636588.707485:0:9833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636588.707488:0:9833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636588.707490:0:9833:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788636588.707493:0:9833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788636588.707549:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788636588.707570:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788636588.707583:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.707594:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636588.707604:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788636588.707607:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00f150000 from 39 10000000:01000000:1.0:1788636588.707609:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788636588.707634:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.707642:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.707652:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636588.707663:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929088:0@lo:101: 00000100:00100000:1.0:1788636588.707692:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636588.707705:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636588.707715:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225929088 00000100:00100000:1.0:1788636588.707718:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225929088 00000100:00100000:3.0:1788636588.707935:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788636588.707946:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225929088:12345-0@lo:101: 00010000:00010000:3.0:1788636588.707955:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636588.707975:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e838152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83814b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.707997:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e838152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83814b expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.708009:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e838152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83814b expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.708018:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153fa00, rc 0) 00000100:00100000:3.0:1788636588.708051:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225929088:12345-0@lo:101: Request processed in 108us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.708056:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788636588.708085:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929088:0@lo:101: 00010000:00010000:3.0:1788636588.708098:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.708108:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636588.708152:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929216:0@lo:501: 00000100:00100000:3.0:1788636588.708174:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.708194:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.708203:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225929216 00000100:00100000:3.0:1788636588.708207:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225929216 00000100:00100000:3.0:1788636588.708223:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788636588.708229:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225929216:12345-0@lo:501: 00000100:00100000:3.0:1788636588.708325:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225929216:12345-0@lo:501: Request processed in 96us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.708340:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788636588.708367:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929216:0@lo:501: 00000100:00100000:3.0:1788636588.708389:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929344:0@lo:503: 00000100:00100000:3.0:1788636588.708421:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.708433:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.708443:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225929344 00000100:00100000:3.0:1788636588.708446:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225929344 00000100:00100000:3.0:1788636588.708460:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788636588.708465:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225929344:12345-0@lo:503: 00000100:00100000:3.0:1788636588.708524:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225929344:12345-0@lo:503: Request processed in 58us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.708530:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788636588.708560:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929344:0@lo:503: 00000100:00100000:2.0:1788636588.710392:0:9834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9834:1875521225929472:0@lo:502: 00000100:00100000:2.0:1788636588.710464:0:9834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.710495:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225929472 00000100:00100000:2.0:1788636588.710500:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225929472 00000100:00100000:2.0:1788636588.710543:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788636588.710552:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:9834:x1875521225929472:12345-0@lo:502: 00000100:00100000:2.0:1788636588.710676:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:9834:x1875521225929472:12345-0@lo:502: Request processed in 124us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636588.710684:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788636588.710747:0:9834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636588.710772:0:9834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9834:1875521225929472:0@lo:502: 00000100:00100000:2.0:1788636588.711034:0:9834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9834:1875521225929600:0@lo:502: 00000100:00100000:2.0:1788636588.711071:0:9834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.711093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225929600 00000100:00100000:2.0:1788636588.711096:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225929600 00000100:00100000:2.0:1788636588.711127:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788636588.711135:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:9834:x1875521225929600:12345-0@lo:502: 00000100:00100000:2.0:1788636588.711196:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:9834:x1875521225929600:12345-0@lo:502: Request processed in 62us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636588.711202:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788636588.711234:0:9834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00848ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636588.711246:0:9834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9834:1875521225929600:0@lo:502: 00000040:00080000:2.0:1788636588.711265:0:9834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788636588.711463:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788636588.711488:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788636588.711501:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.711514:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636588.711524:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788636588.711527:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf00f150000 from 6 10000000:01000000:3.0:1788636588.711530:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788636588.711561:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.711583:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.711593:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636588.711608:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929728:0@lo:101: 00000100:00100000:3.0:1788636588.711644:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.711666:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636588.711715:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225929728 00000100:00100000:1.0:1788636588.711726:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225929728 00000100:00100000:1.0:1788636588.711772:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788636588.711780:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225929728:12345-0@lo:101: 00010000:00010000:1.0:1788636588.711789:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636588.711803:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015991000/0x5b741ef42e838160 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838159 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.712018:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015991000/0x5b741ef42e838160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838159 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.712029:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015991000/0x5b741ef42e838160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838159 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.712038:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015991000, rc 0) 00000100:00100000:1.0:1788636588.712116:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225929728:12345-0@lo:101: Request processed in 337us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636588.712122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788636588.718232:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929728:0@lo:101: 00010000:00010000:3.0:1788636588.718264:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.718288:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636588.718570:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929856:0@lo:256: 00000100:00100000:1.0:1788636588.718641:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636588.718720:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.724217:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225929856 00000100:00100000:3.0:1788636588.724247:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225929856 00000100:00100000:2.0:1788636588.725852:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788636588.725865:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225929856:12345-0@lo:256: 20000000:01000000:2.0:1788636588.725891:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788636588.725907:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788636588.725910:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788636588.726066:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225929856:12345-0@lo:256: Request processed in 202us (7424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636588.726073:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788636588.727985:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929856:0@lo:256: 10000000:01000000:1.0:1788636588.728044:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788636588.728055:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.728065:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636588.728075:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788636588.728082:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:1.0:1788636588.728085:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788636588.728116:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.728125:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.728134:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636588.728151:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929984:0@lo:101: 00000100:00100000:1.0:1788636588.728200:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636588.728242:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.728646:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225929984 00000100:00100000:3.0:1788636588.728654:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225929984 00000100:00100000:3.0:1788636588.728703:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788636588.728712:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225929984:12345-0@lo:101: 00010000:00010000:3.0:1788636588.728725:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636588.728798:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83816e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838167 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.728924:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83816e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838167 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.728948:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83816e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838167 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.728958:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e400, rc 0) 00000100:00100000:3.0:1788636588.729003:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225929984:12345-0@lo:101: Request processed in 292us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.729010:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788636588.729985:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225929984:0@lo:101: 00010000:00010000:1.0:1788636588.730007:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.730018:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636588.730101:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225930112:0@lo:501: 00000100:00100000:1.0:1788636588.730149:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636588.730188:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.730356:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225930112 00000100:00100000:3.0:1788636588.730362:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225930112 00000100:00100000:3.0:1788636588.730485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788636588.730495:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225930112:12345-0@lo:501: 00000100:00100000:3.0:1788636588.730637:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225930112:12345-0@lo:501: Request processed in 144us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.730645:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788636588.732007:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225930112:0@lo:501: 00000100:00100000:1.0:1788636588.732085:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225930240:0@lo:503: 00000100:00100000:1.0:1788636588.732168:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636588.732207:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636588.741972:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225930240 00000100:00100000:0.0:1788636588.741990:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225930240 00000100:00100000:0.0:1788636588.742096:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788636588.742110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225930240:12345-0@lo:503: 00000100:00100000:0.0:1788636588.742600:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225930240:12345-0@lo:503: Request processed in 491us (10430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.742609:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788636588.742779:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225930240:0@lo:503: 00000100:00100000:2.0:1788636588.749190:0:9837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9837:1875521225930368:0@lo:502: 00000100:00100000:2.0:1788636588.749303:0:9837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.756171:0:9837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636588.756533:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225930368 00000100:00100000:0.0:1788636588.756543:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225930368 00000100:00100000:0.0:1788636588.757664:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788636588.757676:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:9837:x1875521225930368:12345-0@lo:502: 00000100:00100000:0.0:1788636588.757942:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:9837:x1875521225930368:12345-0@lo:502: Request processed in 268us (8639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.757951:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788636588.777445:0:9837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9837:1875521225930368:0@lo:502: 00000020:01000000:2.0:1788636588.777518:0:9837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788636588.777528:0:9837:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788636588.777537:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636588.777539:0:9837:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788636588.777546:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788636588.777550:0:9837:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:01000000:2.0:1788636588.777579:0:9837:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788636588.777582:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788636588.777616:0:9837:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9cef0323b380) 00000020:00000080:2.0:1788636588.777650:0:9837:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788636588.777657:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788636588.777756:0:9837:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788636588.777762:0:9837:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788636588.777770:0:9837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e83817c 00010000:00080000:2.0:1788636588.777804:0:9837:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef0235b800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.126@tcp at head 00010000:00010000:2.0:1788636588.778106:0:9837:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788636588.778286:0:9837:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788636588.778301:0:9837:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788636588.778488:0:9837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636588.778593:0:9837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636588.778729:0:9837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788636588.778856:0:9837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788636588.781359:0:9839:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636588.781367:0:9839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788636588.783709:0:9837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788636588.783724:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788636588.783783:0:9837:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788636588.783828:0:9837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e838183 00000100:00080000:2.0:1788636588.784039:0:9837:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788636588.784047:0:9837:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cef0235b800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636588.784087:0:9837:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef03247800 x1875521225930496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788636588.784115:0:9837:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788636588.784167:0:9837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636588.784171:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636588.784173:0:9837:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788636588.784176:0:9837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636588.784180:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636588.784181:0:9837:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788636588.784183:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788636588.784185:0:9837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788636588.784213:0:9837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9837:1875521225930624:0@lo:502: 00000100:00100000:2.0:1788636588.784303:0:9837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.784338:0:9837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636588.784479:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225930624 00000100:00100000:0.0:1788636588.784486:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225930624 00000100:00100000:3.0:1788636588.784495:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521225930496:0@lo:8: 00000100:00100000:0.0:1788636588.784531:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788636588.784536:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.784539:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:9837:x1875521225930624:12345-0@lo:502: 00000100:00100000:3.0:1788636588.784567:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225930496 00000100:00100000:3.0:1788636588.784571:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225930496 00000100:00100000:3.0:1788636588.784592:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636588.784596:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875521225930496:12345-0@lo:8: 00010000:00080000:3.0:1788636588.784616:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1788636588.784641:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e83818a 00000100:00100000:0.0:1788636588.784647:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:9837:x1875521225930624:12345-0@lo:502: Request processed in 108us (344us total) trans 0 rc 0/0 00002000:00100000:3.0:1788636588.784654:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9cef03100000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00000100:00100000:0.0:1788636588.784654:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00002000:00080000:3.0:1788636588.784658:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788636588.784662:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788636588.784689:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225930880:0@lo:400: 00000100:00100000:0.0:1788636588.784714:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:3.0:1788636588.784724:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788636588.784732:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225931392:0@lo:400: 00000100:00100000:0.0:1788636588.784756:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.784773:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225931904:0@lo:400: 00000100:00100000:0.0:1788636588.784794:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.784837:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788636588.784844:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225930752:0@lo:400: 00000100:00100000:0.0:1788636588.784865:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.784882:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521225931264:0@lo:400: 00000100:00100000:0.0:1788636588.784902:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.784913:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521225931776:0@lo:400: 00000100:00100000:0.0:1788636588.784934:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.785034:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225931008:0@lo:400: 00000100:00100000:0.0:1788636588.785061:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.785072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225931520:0@lo:400: 00000100:00100000:0.0:1788636588.785102:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.785122:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788636588.785127:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225931136:0@lo:400: 00000100:00100000:0.0:1788636588.785147:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.785170:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225931648:0@lo:400: 00000100:00100000:0.0:1788636588.785191:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.785366:0:9837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9837:1875521225930624:0@lo:502: 00000020:01000000:0.0:1788636588.785390:0:9837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636588.785395:0:9837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636588.785397:0:9837:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788636588.785401:0:9837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:0.0:1788636588.785513:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225930880 00000100:00100000:0.0:1788636588.785517:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225930880 00000100:00100000:0.0:1788636588.785550:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225931136 00000100:00100000:0.0:1788636588.785554:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225931136 00000100:00100000:0.0:1788636588.785567:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636588.785573:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225930880:12345-0@lo:400: 00000100:00100000:0.0:1788636588.785612:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225930880:12345-0@lo:400: Request processed in 39us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.785618:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636588.785631:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788636588.785636:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225931136:12345-0@lo:400: 00000100:00100000:0.0:1788636588.785664:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225931136:12345-0@lo:400: Request processed in 28us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.785670:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788636588.785695:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225930880:0@lo:400: 00000100:00100000:0.0:1788636588.785718:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225931136:0@lo:400: 00002000:00080000:3.0:1788636588.785949:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788636588.785972:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9cef03106000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636588.786056:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875521225930496:12345-0@lo:8: Request processed in 1457us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.786063:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636588.786075:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225931520 00000100:00100000:3.0:1788636588.786079:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225931520 00000100:00100000:3.0:1788636588.786095:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225931648 00000100:00100000:3.0:1788636588.786098:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225931648 00000100:00100000:3.0:1788636588.786110:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788636588.786116:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225931520:12345-0@lo:400: 00000100:00100000:3.0:1788636588.786154:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225931520:12345-0@lo:400: Request processed in 37us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.786161:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788636588.786172:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636588.786178:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225931648:12345-0@lo:400: 00000100:00100000:3.0:1788636588.786203:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225931648:12345-0@lo:400: Request processed in 26us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.786208:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636588.786229:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225931392 00000100:00100000:3.0:1788636588.786233:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225931392 00000100:00100000:3.0:1788636588.786249:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225931904 00000100:00100000:3.0:1788636588.786251:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225931904 00000100:00100000:3.0:1788636588.786259:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225930752 00000100:00100000:3.0:1788636588.786262:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225930752 00000100:00100000:3.0:1788636588.786270:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225931264 00000100:00100000:3.0:1788636588.786284:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225931264 00000100:00100000:3.0:1788636588.786299:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225931776 00000100:00100000:3.0:1788636588.786301:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225931776 00000100:00100000:3.0:1788636588.786324:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225931008 00000100:00100000:3.0:1788636588.786327:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225931008 00000100:00100000:3.0:1788636588.786341:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788636588.786346:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225931392:12345-0@lo:400: 00000100:00100000:3.0:1788636588.786380:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225931392:12345-0@lo:400: Request processed in 34us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.786399:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788636588.786411:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788636588.786417:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225931904:12345-0@lo:400: 00000100:00100000:3.0:1788636588.786440:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225931904:12345-0@lo:400: Request processed in 24us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.786445:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788636588.786454:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788636588.786459:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225930752:12345-0@lo:400: 00000100:00100000:3.0:1788636588.786480:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225930752:12345-0@lo:400: Request processed in 21us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.786484:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788636588.786495:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788636588.786500:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521225931264:12345-0@lo:400: 00000100:00100000:3.0:1788636588.786524:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521225931264:12345-0@lo:400: Request processed in 25us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.786530:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788636588.786540:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636588.786546:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521225931776:12345-0@lo:400: 00000100:00100000:3.0:1788636588.786570:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521225931776:12345-0@lo:400: Request processed in 25us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.786584:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636588.786597:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788636588.786602:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225931008:12345-0@lo:400: 00000100:00100000:3.0:1788636588.786628:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225931008:12345-0@lo:400: Request processed in 27us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.786633:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788636588.787124:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02710700 x1875521225931648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.787138:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225931648:0@lo:400: 00010000:00080000:0.0:1788636588.787163:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02710a80 x1875521225931008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.787171:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225931008:0@lo:400: 00010000:00080000:0.0:1788636588.787181:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02711f80 x1875521225931520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.787190:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225931520:0@lo:400: 00000020:01000000:1.0:1788636588.787408:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788636588.787434:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788636588.787445:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.787456:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636588.787466:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788636588.787468:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00324c000 from 39 10000000:01000000:1.0:1788636588.787471:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788636588.787501:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.787509:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636588.787518:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636588.787533:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225932032:0@lo:101: 00000100:00100000:1.0:1788636588.787574:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.787597:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225932032 00000100:00100000:1.0:1788636588.787602:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.787603:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225932032 00010000:00080000:0.0:1788636588.787733:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02711c00 x1875521225930752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.787744:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225930752:0@lo:400: 00010000:00080000:0.0:1788636588.787757:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02710e00 x1875521225931264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.787765:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521225931264:0@lo:400: 00010000:00080000:0.0:1788636588.787777:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02712680 x1875521225931776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.787785:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521225931776:0@lo:400: 00010000:00080000:0.0:1788636588.787796:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02711500 x1875521225931392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.787803:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225931392:0@lo:400: 00010000:00080000:2.0:1788636588.791040:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03247800 x1875521225930496/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636588.791062:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788636588.791076:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788636588.791088:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788636588.791097:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788636588.791103:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef0235b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788636588.791137:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788636588.791145:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521225930496:0@lo:8: 00000004:00080000:2.0:1788636588.791206:0:9839:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788636588.791323:0:9839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 257602515395ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788636588.791331:0:9839:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788636588.792715:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788636588.792752:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225932032:12345-0@lo:101: 00010000:00010000:3.0:1788636588.792778:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636588.792801:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838198 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838191 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.793026:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838191 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.793042:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838191 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.793052:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153fc00, rc 0) 00000100:00100000:3.0:1788636588.793152:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225932032:12345-0@lo:101: Request processed in 424us (5576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.793159:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788636588.793214:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225932032:0@lo:101: 00010000:00010000:3.0:1788636588.793232:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.793261:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636588.793353:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225932160:0@lo:501: 00010000:00080000:0.0:1788636588.793371:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02713100 x1875521225931904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.793384:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225931904:0@lo:400: 00000100:00100000:3.0:1788636588.793594:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.793618:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.793636:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225932160 00000100:00100000:3.0:1788636588.793641:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225932160 00000100:00100000:3.0:1788636588.793670:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788636588.793676:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225932160:12345-0@lo:501: 00000100:00100000:3.0:1788636588.793984:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225932160:12345-0@lo:501: Request processed in 306us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.793991:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788636588.794015:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225932160:0@lo:501: 00000100:00100000:3.0:1788636588.794042:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225932288:0@lo:503: 00000100:00100000:3.0:1788636588.794081:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.794090:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaae6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.794106:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225932288 00000100:00100000:3.0:1788636588.794110:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225932288 00000100:00100000:3.0:1788636588.794125:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788636588.794130:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225932288:12345-0@lo:503: 00000100:00100000:3.0:1788636588.794219:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225932288:12345-0@lo:503: Request processed in 89us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.794226:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788636588.794257:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225932288:0@lo:503: 00000100:00100000:3.0:1788636588.794337:0:9840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9840:1875521225932416:0@lo:700: 00000100:00100000:3.0:1788636588.794363:0:9840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.794726:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225932416 00000100:00100000:2.0:1788636588.794878:0:9840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaae780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.794997:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225932416 00000100:00100000:3.0:1788636588.795049:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636588.795057:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9840:x1875521225932416:12345-0@lo:700: 00000100:00100000:3.0:1788636588.795093:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8445:1875521225932544:0@lo:700: 00000100:00100000:3.0:1788636588.795137:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.795160:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaae300 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.795182:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225932544 00000100:00100000:3.0:1788636588.795185:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225932544 00000100:00100000:3.0:1788636588.795211:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636588.795217:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8445:x1875521225932544:12345-0@lo:700: 00000100:00080000:2.0:1788636588.795517:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788636588.797186:0:7453:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788636588.797553:0:9841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9841:1875521225932672:0@lo:502: 00000100:00100000:2.0:1788636588.797646:0:9841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.797696:0:9841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.798501:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225932672 00000100:00100000:3.0:1788636588.798512:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225932672 00000100:00100000:3.0:1788636588.798568:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788636588.798578:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:9841:x1875521225932672:12345-0@lo:502: 00000100:00100000:3.0:1788636588.798987:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:9841:x1875521225932672:12345-0@lo:502: Request processed in 409us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.798994:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788636588.799118:0:9841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9841:1875521225932672:0@lo:502: 00000100:00100000:2.0:1788636588.799184:0:9841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9841:1875521225932800:0@lo:502: 00000100:00100000:2.0:1788636588.799220:0:9841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636588.799246:0:9841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788636588.801697:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225932800 00000100:00100000:0.0:1788636588.801731:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225932800 00000100:00100000:0.0:1788636588.801798:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788636588.801825:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:9841:x1875521225932800:12345-0@lo:502: 00000100:00100000:0.0:1788636588.802074:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:9841:x1875521225932800:12345-0@lo:502: Request processed in 264us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.802083:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788636588.802195:0:9841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9841:1875521225932800:0@lo:502: 00000040:00080000:3.0:1788636588.802237:0:9841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788636588.802637:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788636588.802664:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788636588.802675:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.802688:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636588.802698:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788636588.802701:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf00324c000 from 6 10000000:01000000:2.0:1788636588.802704:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788636588.802969:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.802978:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.802988:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636588.803067:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225932928:0@lo:101: 00000100:00100000:3.0:1788636588.803127:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.803174:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaaecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636588.804937:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225932928 00000100:00100000:2.0:1788636588.804953:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225932928 00000100:00100000:2.0:1788636588.805035:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788636588.805045:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225932928:12345-0@lo:101: 00010000:00010000:2.0:1788636588.805063:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636588.805083:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e8381a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83819f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.805115:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e8381a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83819f expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.805128:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e8381a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83819f expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636588.805159:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015ecf200, rc 0) 00000100:00100000:2.0:1788636588.805303:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225932928:12345-0@lo:101: Request processed in 258us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636588.805310:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788636588.805522:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225932928:0@lo:101: 00010000:00010000:3.0:1788636588.805553:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.805564:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636588.805635:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225933056:0@lo:256: 00000100:00100000:3.0:1788636588.805680:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.805714:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaaecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.805744:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225933056 00000100:00100000:3.0:1788636588.805748:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225933056 00000100:00100000:3.0:1788636588.805784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788636588.805791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225933056:12345-0@lo:256: 20000000:01000000:3.0:1788636588.805822:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788636588.806158:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788636588.806163:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788636588.806247:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225933056:12345-0@lo:256: Request processed in 456us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.806254:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788636588.808706:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225933056:0@lo:256: 10000000:01000000:3.0:1788636588.809602:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788636588.809617:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.809635:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636588.809648:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788636588.809655:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788636588.809659:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788636588.809705:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.809714:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.809725:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636588.809769:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225933184:0@lo:101: 40000000:02000000:0.0:1788636588.810925:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1788636588.811597:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.811644:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaaecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.811669:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225933184 00000100:00100000:3.0:1788636588.811678:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225933184 00000100:00100000:3.0:1788636588.811753:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788636588.811763:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225933184:12345-0@lo:101: 00010000:00010000:3.0:1788636588.811778:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636588.811793:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8381b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8381ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.811833:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8381b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8381ad expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.813511:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8381b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8381ad expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.813523:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e200, rc 0) 00000100:00100000:3.0:1788636588.813605:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225933184:12345-0@lo:101: Request processed in 1843us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.813622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788636588.813701:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225933184:0@lo:101: 00010000:00010000:3.0:1788636588.813723:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.813747:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636588.815044:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225933312:0@lo:501: 00000100:00100000:3.0:1788636588.815124:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.815183:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.815215:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225933312 00000100:00100000:3.0:1788636588.815223:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225933312 00000100:00100000:3.0:1788636588.815290:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788636588.815301:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225933312:12345-0@lo:501: 00000100:00100000:3.0:1788636588.815454:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225933312:12345-0@lo:501: Request processed in 155us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.815460:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788636588.815501:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225933312:0@lo:501: 00000100:00100000:3.0:1788636588.815531:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225933440:0@lo:503: 00000100:00100000:3.0:1788636588.815577:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.815588:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.815598:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225933440 00000100:00100000:3.0:1788636588.815601:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225933440 00000100:00100000:3.0:1788636588.815616:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788636588.815621:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225933440:12345-0@lo:503: 00000100:00100000:3.0:1788636588.815694:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225933440:12345-0@lo:503: Request processed in 72us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.815701:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788636588.818896:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225933440:0@lo:503: 00000100:00100000:3.0:1788636588.823376:0:9842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9842:1875521225933568:0@lo:502: 00000100:00100000:3.0:1788636588.823465:0:9842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.823508:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225933568 00000100:00100000:3.0:1788636588.823515:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225933568 00000100:00100000:3.0:1788636588.823571:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788636588.823581:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:9842:x1875521225933568:12345-0@lo:502: 00000100:00100000:3.0:1788636588.823719:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:9842:x1875521225933568:12345-0@lo:502: Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.823727:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788636588.823784:0:9842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.823831:0:9842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9842:1875521225933568:0@lo:502: 00000020:01000000:3.0:1788636588.823863:0:9842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788636588.823874:0:9842:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788636588.823883:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636588.823886:0:9842:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788636588.823892:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788636588.823896:0:9842:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:01000000:3.0:1788636588.823922:0:9842:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788636588.823926:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788636588.823949:0:9842:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cef034b3380) 00000020:00000080:3.0:1788636588.823978:0:9842:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788636588.823986:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788636588.824076:0:9842:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788636588.824088:0:9842:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788636588.824096:0:9842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e8381c2 00010000:00080000:3.0:1788636588.824139:0:9842:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef034cc800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.126@tcp at head 00010000:00010000:3.0:1788636588.824416:0:9842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788636588.824545:0:9842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788636588.824559:0:9842:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788636588.824723:0:9842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636588.824899:0:9842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636588.825026:0:9842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788636588.825114:0:9842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788636588.827415:0:9843:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636588.827422:0:9843:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788636588.829057:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8445:x1875521225932544:12345-0@lo:700: Request processed in 33832us (33912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.829075:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788636588.830026:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320c700 x1875521225932544/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788636604 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.830044:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8445:1875521225932544:0@lo:700: 40000000:02000000:3.0:1788636588.830058:0:8445:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:00000080:0.0:1788636588.830597:0:9842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788636588.830614:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788636588.830664:0:9842:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788636588.830691:0:9842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e8381c9 00000100:00080000:0.0:1788636588.830700:0:9842:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788636588.830706:0:9842:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cef034cc800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636588.830904:0:9842:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef019b0380 x1875521225933696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636588.830923:0:9842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788636588.831048:0:9842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636588.831054:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636588.831056:0:9842:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788636588.831059:0:9842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636588.831063:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636588.831065:0:9842:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788636588.831068:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788636588.831070:0:9842:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788636588.831105:0:9842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02713100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9842:1875521225933824:0@lo:502: 00000100:00100000:0.0:1788636588.831202:0:9842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.831249:0:9842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636588.831524:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521225933696:0@lo:8: 00000100:00100000:2.0:1788636588.831563:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.831827:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225933696 00000100:00100000:0.0:1788636588.831845:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225933696 00000100:00100000:0.0:1788636588.831897:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636588.831907:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875521225933696:12345-0@lo:8: 00010000:00080000:0.0:1788636588.831945:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:0.0:1788636588.831983:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e8381d0 00002000:00100000:0.0:1788636588.832003:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cf03fc19800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788636588.832008:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788636588.832012:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788636588.832107:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788636588.832149:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc1f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636588.832212:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875521225933696:12345-0@lo:8: Request processed in 305us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.832220:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788636588.832268:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef019b0380 x1875521225933696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.832291:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788636588.832302:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788636588.832311:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788636588.832317:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788636588.832320:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef034cc800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788636588.832334:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788636588.832339:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521225933696:0@lo:8: 00000100:00100000:0.0:1788636588.834940:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225933824 00000100:00100000:0.0:1788636588.834958:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225933824 00000100:00100000:0.0:1788636588.835035:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788636588.835058:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:9842:x1875521225933824:12345-0@lo:502: 00000100:00100000:0.0:1788636588.835245:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:9842:x1875521225933824:12345-0@lo:502: Request processed in 189us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.835254:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788636588.835336:0:9842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02713100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:9842:1875521225933824:0@lo:502: 00000020:01000000:0.0:1788636588.835367:0:9842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636588.835374:0:9842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636588.835376:0:9842:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788636588.835393:0:9842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1788636588.839703:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1788636588.839749:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788636588.839761:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.839774:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636588.839785:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788636588.839788:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf040b3b380 from 1 10000000:01000000:3.0:1788636588.839791:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788636588.839844:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.839853:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.839875:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636588.839901:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225933952:0@lo:101: 00000100:00100000:3.0:1788636588.839981:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.840022:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024adb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.840041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225933952 00000100:00100000:3.0:1788636588.840047:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225933952 00000100:00100000:3.0:1788636588.840103:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788636588.840112:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225933952:12345-0@lo:101: 00010000:00010000:3.0:1788636588.840127:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636588.840142:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153e800/0x5b741ef42e8381de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8381d7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.841198:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153e800/0x5b741ef42e8381de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8381d7 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.841224:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153e800/0x5b741ef42e8381de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8381d7 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.841234:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e800, rc 0) 00000100:00100000:3.0:1788636588.841351:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225933952:12345-0@lo:101: Request processed in 1239us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.841359:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788636588.841463:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225933952:0@lo:101: 00010000:00010000:3.0:1788636588.841481:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.841507:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636588.842067:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225934080:0@lo:501: 00000100:00100000:3.0:1788636588.842130:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.842160:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024adb40 going to sleep for 11 seconds 00000004:00080000:3.0:1788636588.843603:0:9843:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788636588.843717:0:9843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 257654908675ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788636588.843725:0:9843:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788636588.845253:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225934080 00000100:00100000:2.0:1788636588.845282:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225934080 00000100:00100000:2.0:1788636588.845360:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788636588.845374:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225934080:12345-0@lo:501: 00000100:00100000:2.0:1788636588.845527:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225934080:12345-0@lo:501: Request processed in 157us (3397us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788636588.845535:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000001:00100000:0.0:1788636588.845618:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788636588.845626:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788636588.845714:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9840:x1875521225932416:12345-0@lo:700: Request processed in 50658us (51350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636588.845730:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788636588.845772:0:9840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320fb80 x1875521225932416/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788636604 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.845774:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225934080:0@lo:501: 00000100:00100000:2.0:1788636588.845792:0:9840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9840:1875521225932416:0@lo:700: 10000000:01000000:3.0:1788636588.845858:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788636588.845870:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636588.845882:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788636588.846210:0:9844:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788636588.846227:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636588.846233:0:9844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9844:1875521225934336:0@lo:7: 00000100:00100000:3.0:1788636588.846238:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225934208:0@lo:13: 00000100:00100000:3.0:1788636588.846268:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.846268:0:9844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.846318:0:9844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0321b0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.846330:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225934336 00000100:00100000:3.0:1788636588.846334:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225934336 00000100:00100000:3.0:1788636588.846387:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636588.846396:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9844:x1875521225934336:12345-0@lo:7: 00000100:00080000:2.0:1788636588.847046:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788636588.851907:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788636588.851919:0:8438:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788636588.852044:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9844:x1875521225934336:12345-0@lo:7: Request processed in 5643us (5769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.852065:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636588.852187:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225934208 00000100:00100000:3.0:1788636588.852197:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225934208 00000100:00100000:3.0:1788636588.852241:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788636588.852251:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225934208:12345-0@lo:13: 00000004:00080000:0.0:1788636588.852265:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00000024:3.0:1788636588.852296:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1788636588.852347:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225934208:12345-0@lo:13: Request processed in 97us (6079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.852354:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788636588.852399:0:9844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02711500 x1875521225934336/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788636604 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.852417:0:9844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9844:1875521225934336:0@lo:7: 00000004:00080000:3.0:1788636588.852432:0:9844:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788636588.852471:0:9844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9844:1875521225934464:0@lo:5: 00000100:00100000:3.0:1788636588.852507:0:9844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788636588.852589:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02713100 x1875521225934208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.852605:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225934208:0@lo:13: 00000100:00100000:3.0:1788636588.852736:0:9844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636588.853035:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225934464 00000100:00100000:0.0:1788636588.853039:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225934464 00000100:00100000:0.0:1788636588.853067:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788636588.853074:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9844:x1875521225934464:12345-0@lo:5: 00002000:00080000:0.0:1788636588.853094:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788636588.856208:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000004:00080000:2.0:1788636588.858748:0:9840:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788636588.858783:0:9840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9840:1875521225934720:0@lo:7: 00000100:00100000:2.0:1788636588.858855:0:9840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636588.858922:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225934592:0@lo:13: 00000100:00100000:0.0:1788636588.858978:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636588.859053:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9844:x1875521225934464:12345-0@lo:5: Request processed in 5977us (6544us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788636588.859064:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788636588.862557:0:9844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320f100 x1875521225934464/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636604 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.862584:0:9844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9844:1875521225934464:0@lo:5: 00000004:00080000:3.0:1788636588.862604:0:9844:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788636588.862662:0:9844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9844:1875521225934848:0@lo:700: 00000100:00100000:3.0:1788636588.863125:0:9844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.863189:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225934848 00000100:00100000:3.0:1788636588.863197:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225934848 00000100:00100000:3.0:1788636588.863292:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636588.863304:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9844:x1875521225934848:12345-0@lo:700: 00000100:00100000:1.0:1788636588.864293:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225934720 00000100:00100000:2.0:1788636588.864296:0:9840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788636588.864319:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225934720 00000100:00100000:1.0:1788636588.864387:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788636588.864406:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9840:x1875521225934720:12345-0@lo:7: 00000100:00100000:0.0:1788636588.865864:0:9844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.866364:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225934592 00000100:00100000:3.0:1788636588.866373:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225934592 00000100:00100000:3.0:1788636588.866441:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636588.866451:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875521225934592:12345-0@lo:13: 00002000:00000024:3.0:1788636588.866497:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1788636588.866570:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875521225934592:12345-0@lo:13: Request processed in 120us (7591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636588.866577:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788636588.869631:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03245180 x1875521225934592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636588.869681:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225934592:0@lo:13: 00000001:00080000:1.0:1788636588.871468:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1788636588.871596:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9844:x1875521225934848:12345-0@lo:700: Request processed in 8292us (8862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636588.871613:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788636588.871761:0:9844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320c380 x1875521225934848/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788636604 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.871770:0:9844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788636588.871781:0:9844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9844:1875521225934848:0@lo:700: 00000004:02000040:3.0:1788636588.875609:0:9844:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788636588.880884:0:9844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9844:1875521225934976:0@lo:5: 00000100:00100000:3.0:1788636588.880955:0:9844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.880997:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788636588.881308:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788636588.881431:0:9844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636588.881728:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225934976 00000100:00100000:3.0:1788636588.881737:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225934976 00000100:00100000:1.0:1788636588.881936:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788636588.881950:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9844:x1875521225934976:12345-0@lo:5: 00002000:00080000:0.0:1788636588.882499:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788636588.882505:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788636588.882585:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9840:x1875521225934720:12345-0@lo:7: Request processed in 18180us (23729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.882593:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788636588.882660:0:9840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03247800 x1875521225934720/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788636604 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.882677:0:9840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9840:1875521225934720:0@lo:7: 00000004:00080000:3.0:1788636588.882690:0:9840:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788636588.882728:0:9840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9840:1875521225935104:0@lo:5: 00000100:00100000:3.0:1788636588.882758:0:9840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.882793:0:9840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad540 going to sleep for 11 seconds 00000100:00100000:0.0:1788636588.882966:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225935104 00000100:00100000:0.0:1788636588.882973:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225935104 00000100:00100000:0.0:1788636588.883010:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788636588.883018:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9840:x1875521225935104:12345-0@lo:5: 00002000:00080000:0.0:1788636588.883036:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788636588.883076:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9840:x1875521225935104:12345-0@lo:5: Request processed in 59us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.883082:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788636588.883249:0:9840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320f800 x1875521225935104/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636604 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636588.883259:0:9840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9840:1875521225935104:0@lo:5: 00000004:00080000:3.0:1788636588.883269:0:9840:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788636588.883303:0:9840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9840:1875521225935232:0@lo:5: 00000100:00100000:3.0:1788636588.883341:0:9840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.883368:0:9840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad540 going to sleep for 11 seconds 00000100:00100000:0.0:1788636588.884957:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225935232 00000100:00100000:0.0:1788636588.884970:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225935232 00000100:00100000:0.0:1788636588.885038:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788636588.885044:0:8438:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788636588.885049:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9840:x1875521225935232:12345-0@lo:5: 00000100:00100000:2.0:1788636588.885054:0:8438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:0.0:1788636588.885099:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788636588.888985:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9840:x1875521225935232:12345-0@lo:5: Request processed in 3930us (5634us total) trans 4294967298 rc 0/0 00010000:00080000:3.0:1788636588.889000:0:9840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320f800 x1875521225935232/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636604 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636588.889001:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636588.889024:0:9840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9840:1875521225935232:0@lo:5: 00000004:00080000:3.0:1788636588.889046:0:9840:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788636588.889751:0:9840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03518a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9840:1875521225935360:0@lo:900: 00000100:00100000:3.0:1788636588.889798:0:9840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636588.889850:0:9840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad540 going to sleep for 11 seconds 00000100:00100000:0.0:1788636588.892496:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225935360 00000100:00100000:0.0:1788636588.892514:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225935360 00000100:00100000:0.0:1788636588.892603:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636588.892615:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9840:x1875521225935360:12345-0@lo:900: 00000100:00100000:0.0:1788636588.894048:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9840:x1875521225935360:12345-0@lo:900: Request processed in 1427us (4241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636588.894072:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788636588.894442:0:9840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03518a80 x1875521225935360/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788636604 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636588.894461:0:9840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03518a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9840:1875521225935360:0@lo:900: 00002000:00080000:3.0:1788636588.898480:0:9845:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788636588.898504:0:9845:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788636588.906872:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9844:x1875521225934976:12345-0@lo:5: Request processed in 24913us (25904us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788636588.906890:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788636588.906917:0:9844:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320c380 x1875521225934976/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636604 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636588.906942:0:9844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9844:1875521225934976:0@lo:5: 00000004:00080000:2.0:1788636588.906963:0:9844:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:0.0:1788636589.396730:0:9887:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788636589.463767:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788636590.278438:0:9940:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788636590.278691:0:9940:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788636590.498730:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788636591.128431:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1788636591.128460:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788636591.509307:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636591.765079:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636591.765109:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225935488:0@lo:41: 00000100:00100000:0.0:1788636591.765183:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636591.765376:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225935488 00000100:00100000:2.0:1788636591.765385:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225935488 00000100:00100000:2.0:1788636591.765446:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788636591.765456:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225935488:12345-0@lo:41: 00000004:00000024:2.0:1788636591.765491:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636591.765553:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225935488:12345-0@lo:41: Request processed in 99us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636591.765561:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788636591.765650:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225935488:0@lo:41: 00000100:00100000:2.0:1788636591.767394:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225935616:0@lo:13: 00000100:00100000:2.0:1788636591.767483:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636591.767597:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225935616 00000100:00100000:1.0:1788636591.767606:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225935616 00000100:00100000:1.0:1788636591.767668:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788636591.767679:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225935616:12345-0@lo:13: 00002000:00000024:1.0:1788636591.767709:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636591.767758:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03247100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225935616:12345-0@lo:13: Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636591.767764:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788636591.767801:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03aba5500 x1875521225935616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636591.767840:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225935616:0@lo:13: 00000100:00080000:2.0:1788636591.767904:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636591.768027:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636591.768037:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225935744:0@lo:13: 00000100:00100000:1.0:1788636591.768065:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636591.768164:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225935744 00000100:00100000:0.0:1788636591.768168:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225935744 00000100:00100000:0.0:1788636591.768202:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636591.768218:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225935744:12345-0@lo:13: 00002000:00000024:0.0:1788636591.768230:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636591.768272:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225935744:12345-0@lo:13: Request processed in 55us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636591.768279:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788636591.768347:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02711c00 x1875521225935744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636591.768363:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225935744:0@lo:13: 00000100:00080000:2.0:1788636591.768417:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788636592.533108:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636592.800598:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225935872:0@lo:41: 00000100:00100000:2.0:1788636592.800683:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636592.800837:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225935872 00000100:00100000:0.0:1788636592.800846:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225935872 00000100:00100000:0.0:1788636592.800895:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788636592.800905:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225935872:12345-0@lo:41: 00000004:00000024:0.0:1788636592.800946:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788636592.801002:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225935872:12345-0@lo:41: Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636592.801010:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788636592.801244:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225935872:0@lo:41: 00000020:00000004:3.0:1788636593.146946:0:10041:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636593.147198:0:10041:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788636593.561005:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788636594.296344:0:10089:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636594.296362:0:10089:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788636594.325093:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225936000:0@lo:13: 00000100:00100000:2.0:1788636594.325248:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636594.325349:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225936000 00000100:00100000:1.0:1788636594.325357:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225936000 00000100:00100000:1.0:1788636594.325427:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788636594.325438:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225936000:12345-0@lo:13: 00002000:00000024:1.0:1788636594.325468:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636594.325513:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225936000:12345-0@lo:13: Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636594.325520:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788636594.326127:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788636594.326455:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03518e00 x1875521225936000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636594.326469:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788636594.326498:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225936000:0@lo:13: 00000100:00100000:3.0:1788636594.328330:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225936128:0@lo:13: 00000100:00100000:3.0:1788636594.328408:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636594.329320:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225936256:0@lo:400: 00000100:00100000:3.0:1788636594.329367:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636594.329434:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225936256 00000100:00100000:2.0:1788636594.329442:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225936256 00000100:00100000:2.0:1788636594.329489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788636594.329498:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225936256:12345-0@lo:400: 00000100:00100000:2.0:1788636594.329729:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225936256:12345-0@lo:400: Request processed in 231us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636594.329738:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788636594.330021:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225936384:0@lo:400: 00000100:00100000:1.0:1788636594.330053:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636594.330072:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225936896:0@lo:400: 00000100:00100000:1.0:1788636594.330091:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636594.330105:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225937408:0@lo:400: 00000100:00100000:1.0:1788636594.330121:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636594.330150:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788636594.330155:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225936768:0@lo:400: 00000100:00100000:1.0:1788636594.330179:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636594.330284:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225936512:0@lo:400: 00000100:00100000:3.0:1788636594.330375:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225936256:0@lo:400: 00000100:00100000:2.0:1788636594.330498:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636594.330524:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225937024:0@lo:400: 00000100:00100000:1.0:1788636594.330710:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225937280:0@lo:400: 00000100:00100000:1.0:1788636594.330752:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636594.330793:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225936384 00000100:00100000:1.0:1788636594.330799:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225936384 00000100:00100000:1.0:1788636594.330854:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225936896 00000100:00100000:1.0:1788636594.330857:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225936896 00000100:00100000:1.0:1788636594.330879:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225937408 00000100:00100000:1.0:1788636594.330882:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225937408 00000100:00100000:1.0:1788636594.330899:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788636594.330905:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225936384:12345-0@lo:400: 00000100:00100000:1.0:1788636594.330947:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225936384:12345-0@lo:400: Request processed in 42us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636594.330953:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788636594.330967:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788636594.330972:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225936896:12345-0@lo:400: 00000100:00100000:1.0:1788636594.330999:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225936896:12345-0@lo:400: Request processed in 26us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636594.331005:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788636594.331015:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788636594.331021:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225937408:12345-0@lo:400: 00000100:00100000:1.0:1788636594.331044:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225937408:12345-0@lo:400: Request processed in 24us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636594.331050:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788636594.331074:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225936768 00000100:00100000:1.0:1788636594.331079:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225936768 00000100:00100000:1.0:1788636594.331100:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225936512 00000100:00100000:1.0:1788636594.331103:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225936512 00000100:00100000:1.0:1788636594.331114:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788636594.331120:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225936768:12345-0@lo:400: 00000100:00100000:2.0:1788636594.331501:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636594.331525:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225937536:0@lo:400: 00000100:00100000:2.0:1788636594.332003:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636594.332030:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788636594.332044:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225936640:0@lo:400: 00000100:00100000:2.0:1788636594.332067:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636594.332083:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225937152:0@lo:400: 00000100:00100000:2.0:1788636594.332101:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636594.332148:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788636594.332158:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225936512:12345-0@lo:400: 00000100:00100000:2.0:1788636594.332329:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225936512:12345-0@lo:400: Request processed in 173us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636594.332337:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788636594.332361:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225937280 00000100:00100000:2.0:1788636594.332367:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225937280 00000100:00100000:1.0:1788636594.332462:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225936768:12345-0@lo:400: Request processed in 1340us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636594.332474:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788636594.332515:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225937152 00000100:00100000:2.0:1788636594.332519:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225937152 00000100:00100000:3.0:1788636594.332745:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636594.332756:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225937280:12345-0@lo:400: 00000100:00100000:3.0:1788636594.332794:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225937280:12345-0@lo:400: Request processed in 42us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636594.332801:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636594.332832:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788636594.332838:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225937152:12345-0@lo:400: 00000100:00100000:3.0:1788636594.332865:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225937152:12345-0@lo:400: Request processed in 27us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636594.332871:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788636594.332930:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636594.332935:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636594.332967:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225936768:0@lo:400: 00010000:00080000:1.0:1788636594.332981:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02463480 x1875521225937280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636594.332990:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225937280:0@lo:400: 00010000:00080000:1.0:1788636594.333002:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03aba4e00 x1875521225936384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636594.333010:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225936384:0@lo:400: 00010000:00080000:1.0:1788636594.333021:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02461880 x1875521225936896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636594.333028:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225936896:0@lo:400: 00010000:00080000:1.0:1788636594.333040:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02461c00 x1875521225937408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636594.333047:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225937408:0@lo:400: 00000100:00100000:1.0:1788636594.333083:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225936128 00000100:00100000:1.0:1788636594.333086:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225936128 00000100:00100000:2.0:1788636594.333184:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225937024 00000100:00100000:2.0:1788636594.333255:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225937024 00000100:00100000:1.0:1788636594.333301:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788636594.333308:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225936128:12345-0@lo:13: 00002000:00000024:1.0:1788636594.333326:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636594.333362:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225936128:12345-0@lo:13: Request processed in 54us (4955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636594.333368:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788636594.333416:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03244000 x1875521225936128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636594.333427:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788636594.333443:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225936128:0@lo:13: 00000100:00080000:3.0:1788636594.333480:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636594.333484:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636594.333738:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225937536 00000100:00100000:2.0:1788636594.333743:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225937536 00000100:00080000:3.0:1788636594.333767:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636594.333889:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225936640 00000100:00100000:2.0:1788636594.333893:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225936640 00000100:00100000:2.0:1788636594.333905:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788636594.333912:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225937024:12345-0@lo:400: 00000100:00100000:2.0:1788636594.333952:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225937024:12345-0@lo:400: Request processed in 41us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636594.333958:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788636594.333969:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788636594.333974:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225937536:12345-0@lo:400: 00000100:00100000:2.0:1788636594.333997:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225937536:12345-0@lo:400: Request processed in 24us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636594.334012:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788636594.334023:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788636594.334027:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225936640:12345-0@lo:400: 00000100:00100000:2.0:1788636594.334052:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225936640:12345-0@lo:400: Request processed in 25us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636594.334057:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1788636594.334109:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02461180 x1875521225936640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636594.334120:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225936640:0@lo:400: 00010000:00080000:2.0:1788636594.334131:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02463b80 x1875521225937152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636594.334149:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02463b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225937152:0@lo:400: 00000100:00100000:2.0:1788636594.334163:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225936512:0@lo:400: 00010000:00080000:2.0:1788636594.334174:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02462300 x1875521225937024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636594.334181:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225937024:0@lo:400: 00010000:00080000:2.0:1788636594.334268:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02460000 x1875521225937536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636594.334276:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225937536:0@lo:400: 00010000:00010000:3.0:1788636594.581461:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636595.605112:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636595.966986:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636595.967512:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207009664 00000100:00100000:2.0:1788636595.967530:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207009664 00000100:00100000:2.0:1788636595.967608:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 183 00000100:00100000:2.0:1788636595.967620:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1875521207009664:12345-192.168.202.26@tcp:250: 00010000:00080000:2.0:1788636595.968178:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3da5b26b-f5ec-400d-b893-346cfc652707@192.168.202.26@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1788636595.968221:0:6513:0:(genops.c:1385:class_connect()) connect: client 3da5b26b-f5ec-400d-b893-346cfc652707, cookie 0x5b741ef42e8381e5 00000100:00080000:2.0:1788636595.969213:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9cef033a4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636595.969389:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+5:2397:x1875521207009664:12345-192.168.202.26@tcp:250: Request processed in 1768us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636595.969402:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 183 00000100:00100000:2.0:1788636595.981400:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636595.981554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207009536 00000100:00100000:3.0:1788636595.981570:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207009536 00000100:00100000:3.0:1788636595.981798:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 184 00000100:00100000:3.0:1788636595.981848:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+5:6160:x1875521207009536:12345-192.168.202.26@tcp:101: 00010000:00010000:3.0:1788636595.981891:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636595.981926:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf000031800/0x5b741ef42e8381ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38e55 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636595.981966:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf000031800/0x5b741ef42e8381ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e55 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636595.981981:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf000031800/0x5b741ef42e8381ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e55 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636595.982003:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000031800, rc 0) 00000100:00100000:3.0:1788636595.982103:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+6:6160:x1875521207009536:12345-192.168.202.26@tcp:101: Request processed in 260us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636595.982111:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 184 00000100:00100000:3.0:1788636595.989005:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636595.989179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207009792 00000100:00100000:2.0:1788636595.989199:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207009792 00000100:00100000:2.0:1788636595.989298:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 185 00000100:00100000:2.0:1788636595.989483:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+6:6160:x1875521207009792:12345-192.168.202.26@tcp:501: 00000100:00100000:2.0:1788636595.990290:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+6:6160:x1875521207009792:12345-192.168.202.26@tcp:501: Request processed in 976us (1300us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788636595.990301:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 185 00000100:00100000:0.0:1788636596.005872:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636596.006025:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207009920 00000100:00100000:3.0:1788636596.006039:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207009920 00000100:00100000:3.0:1788636596.006127:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 186 00000100:00100000:3.0:1788636596.006140:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+6:6160:x1875521207009920:12345-192.168.202.26@tcp:101: 00010000:00010000:3.0:1788636596.006165:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636596.006189:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf000031a00/0x5b741ef42e8381f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38e5c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636596.006229:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf000031a00/0x5b741ef42e8381f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e5c expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636596.006244:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf000031a00/0x5b741ef42e8381f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e5c expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636596.006290:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000031a00, rc 0) 00000100:00100000:3.0:1788636596.006535:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+7:6160:x1875521207009920:12345-192.168.202.26@tcp:101: Request processed in 397us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636596.006542:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 186 00000100:00100000:1.0:1788636596.010565:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636596.010904:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207010048 00000100:00100000:2.0:1788636596.010919:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207010048 00000100:00100000:2.0:1788636596.011040:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 187 00000100:00100000:2.0:1788636596.011053:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+7:6160:x1875521207010048:12345-192.168.202.26@tcp:501: 00000100:00100000:2.0:1788636596.011312:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+8:6160:x1875521207010048:12345-192.168.202.26@tcp:501: Request processed in 261us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636596.011321:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 187 00000100:00100000:1.0:1788636596.025442:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636596.025692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207010176 00000100:00100000:2.0:1788636596.025707:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207010176 00000100:00100000:2.0:1788636596.026069:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 188 00000100:00100000:2.0:1788636596.026095:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+8:6160:x1875521207010176:12345-192.168.202.26@tcp:503: 00000100:00100000:2.0:1788636596.026357:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+8:6160:x1875521207010176:12345-192.168.202.26@tcp:503: Request processed in 274us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636596.026366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 188 00000100:00100000:0.0:1788636596.036072:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636596.036259:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207010304 00000100:00100000:3.0:1788636596.036273:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207010304 00000100:00100000:3.0:1788636596.036354:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 189 00000100:00100000:3.0:1788636596.036367:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+8:6179:x1875521207010304:12345-192.168.202.26@tcp:502: 00000100:00100000:3.0:1788636596.036639:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+8:6179:x1875521207010304:12345-192.168.202.26@tcp:502: Request processed in 274us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636596.036648:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 189 00000100:00100000:1.0:1788636596.102197:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636596.102902:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207010432 00000100:00100000:3.0:1788636596.102917:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207010432 00000100:00100000:3.0:1788636596.102985:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 190 00000100:00100000:3.0:1788636596.102998:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+8:6179:x1875521207010432:12345-192.168.202.26@tcp:502: 00000100:00100000:3.0:1788636596.103237:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+8:6179:x1875521207010432:12345-192.168.202.26@tcp:502: Request processed in 240us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636596.103245:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 190 00000100:00100000:1.0:1788636596.111267:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636596.111426:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207010560 00000100:00100000:2.0:1788636596.111441:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207010560 00000100:00100000:2.0:1788636596.111514:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 191 00000100:00100000:2.0:1788636596.111527:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+8:6160:x1875521207010560:12345-192.168.202.26@tcp:101: 00010000:00010000:2.0:1788636596.111549:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636596.111584:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015ece000/0x5b741ef42e8381fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38e8d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636596.111623:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015ece000/0x5b741ef42e8381fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e8d expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636596.111638:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015ece000/0x5b741ef42e8381fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e8d expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636596.111650:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015ece000, rc 0) 00000100:00100000:2.0:1788636596.112055:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+9:6160:x1875521207010560:12345-192.168.202.26@tcp:101: Request processed in 528us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636596.112063:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 191 00000100:00100000:1.0:1788636596.121617:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636596.121787:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207010688 00000100:00100000:0.0:1788636596.121802:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207010688 00000100:00100000:0.0:1788636596.121915:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 192 00000100:00100000:0.0:1788636596.121928:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+9:6160:x1875521207010688:12345-192.168.202.26@tcp:256: 20000000:01000000:0.0:1788636596.121962:0:6516:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788636596.121997:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788636596.122002:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788636596.122005:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788636596.122008:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788636596.122010:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788636596.127977:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+9:6160:x1875521207010688:12345-192.168.202.26@tcp:256: Request processed in 6029us (6354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636596.127998:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 192 00000100:00100000:1.0:1788636596.131345:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636596.131453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207010816 00000100:00100000:0.0:1788636596.131467:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207010816 00000100:00100000:0.0:1788636596.131537:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 193 00000100:00100000:0.0:1788636596.131549:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+9:6160:x1875521207010816:12345-192.168.202.26@tcp:101: 00010000:00010000:0.0:1788636596.131685:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636596.131712:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838201 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38e94 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636596.131748:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e94 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636596.131761:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e94 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636596.131793:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7600, rc 0) 00000100:00100000:0.0:1788636596.132281:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:6160:x1875521207010816:12345-192.168.202.26@tcp:101: Request processed in 730us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636596.132290:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 193 00000100:00100000:1.0:1788636596.138896:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636596.139010:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207010944 00000100:00100000:0.0:1788636596.139025:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207010944 00000100:00100000:0.0:1788636596.139107:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 194 00000100:00100000:0.0:1788636596.139120:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:6160:x1875521207010944:12345-192.168.202.26@tcp:501: 00000100:00100000:0.0:1788636596.139358:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:6160:x1875521207010944:12345-192.168.202.26@tcp:501: Request processed in 240us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636596.139367:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 194 00000100:00100000:1.0:1788636596.141723:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636596.141875:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207011072 00000100:00100000:0.0:1788636596.141886:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207011072 00000100:00100000:0.0:1788636596.141947:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 195 00000100:00100000:0.0:1788636596.141957:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:6160:x1875521207011072:12345-192.168.202.26@tcp:503: 00000100:00100000:0.0:1788636596.142146:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:6160:x1875521207011072:12345-192.168.202.26@tcp:503: Request processed in 189us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636596.142155:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 195 00000100:00100000:1.0:1788636596.148742:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636596.148942:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207011200 00000100:00100000:3.0:1788636596.148957:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207011200 00000100:00100000:3.0:1788636596.149047:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 196 00000100:00100000:3.0:1788636596.149059:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:6185:x1875521207011200:12345-192.168.202.26@tcp:502: 00000100:00100000:3.0:1788636596.149303:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:6185:x1875521207011200:12345-192.168.202.26@tcp:502: Request processed in 245us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636596.149322:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 196 00000100:00100000:1.0:1788636596.153308:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636596.160772:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207011328 00000100:00100000:3.0:1788636596.160801:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207011328 00000100:00100000:2.0:1788636596.161099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 197 00000100:00100000:2.0:1788636596.161114:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:6185:x1875521207011328:12345-192.168.202.26@tcp:502: 00000100:00100000:2.0:1788636596.161502:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:6185:x1875521207011328:12345-192.168.202.26@tcp:502: Request processed in 390us (8206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636596.161512:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 197 00000100:00100000:1.0:1788636596.177191:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636596.177246:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636596.177355:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207011456 00000100:00100000:3.0:1788636596.177369:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207011456 00000100:00100000:3.0:1788636596.177427:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207011712 00000100:00100000:3.0:1788636596.177431:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207011712 00000100:00100000:3.0:1788636596.177447:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:3.0:1788636596.177458:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875521207011456:12345-192.168.202.26@tcp:38: 00010000:00080000:3.0:1788636596.177503:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:3.0:1788636596.177583:0:6522:0:(genops.c:1385:class_connect()) connect: client a3091a46-1ad5-4415-b7a7-5e4bfab40689, cookie 0x5b741ef42e838208 00000004:00100000:3.0:1788636596.177627:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788636596.177967:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9cef034c9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636596.178049:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2397:x1875521207011456:12345-192.168.202.26@tcp:38: Request processed in 592us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636596.178057:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:3.0:1788636596.178093:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 8 00000100:00100000:3.0:1788636596.178098:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875521207011712:12345-192.168.202.26@tcp:38: 00010000:00080000:3.0:1788636596.178116:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:3.0:1788636596.178156:0:6522:0:(genops.c:1385:class_connect()) connect: client a3091a46-1ad5-4415-b7a7-5e4bfab40689, cookie 0x5b741ef42e83820f 00000004:00100000:3.0:1788636596.178171:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788636596.178326:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9cef034c8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636596.178352:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2397:x1875521207011712:12345-192.168.202.26@tcp:38: Request processed in 253us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636596.178359:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 8 00010000:00010000:0.0:1788636596.629908:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636596.885284:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225937664:0@lo:13: 00000100:00100000:3.0:1788636596.885427:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636596.885575:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225937664 00000100:00100000:2.0:1788636596.885588:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225937664 00000100:00100000:2.0:1788636596.885668:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788636596.885682:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225937664:12345-0@lo:13: 00002000:00000024:2.0:1788636596.885723:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636596.885791:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225937664:12345-0@lo:13: Request processed in 113us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636596.885799:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788636596.885885:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0337c380 x1875521225937664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636596.885907:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225937664:0@lo:13: 00000100:00080000:3.0:1788636596.886033:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636596.886098:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225937792:0@lo:41: 00000100:00100000:1.0:1788636596.886156:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636596.886358:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225937792 00000100:00100000:3.0:1788636596.886364:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225937792 00000100:00100000:3.0:1788636596.886411:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788636596.886420:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225937792:12345-0@lo:41: 00000004:00000024:3.0:1788636596.886452:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788636596.886623:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225937792:12345-0@lo:41: Request processed in 203us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636596.886630:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788636596.886706:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225937792:0@lo:41: 00000100:00100000:2.0:1788636596.891605:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636596.891648:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225937920:0@lo:13: 00000100:00100000:2.0:1788636596.891757:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636596.893744:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225937920 00000100:00100000:3.0:1788636596.893766:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225937920 00000100:00100000:3.0:1788636596.893962:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636596.893977:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225937920:12345-0@lo:13: 00002000:00000024:3.0:1788636596.894022:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636596.894171:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225937920:12345-0@lo:13: Request processed in 197us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636596.894181:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788636596.894433:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02710a80 x1875521225937920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636596.894490:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225937920:0@lo:13: 00000100:00080000:1.0:1788636596.895336:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636597.193430:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636597.193477:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636597.193883:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636597.194257:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207011968 00000100:00100000:0.0:1788636597.194273:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207011968 00000100:00100000:0.0:1788636597.194789:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207011584 00000100:00100000:0.0:1788636597.194795:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207011584 00000100:00100000:0.0:1788636597.194851:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207011840 00000100:00100000:0.0:1788636597.194853:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207011840 00000100:00100000:0.0:1788636597.194880:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 9 00000100:00100000:0.0:1788636597.194910:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:6160:x1875521207011968:12345-192.168.202.26@tcp:41: 00000100:00080000:1.0:1788636597.195562:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636597.195669:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788636597.195864:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788636597.196132:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:6160:x1875521207011968:12345-192.168.202.26@tcp:41: Request processed in 1219us (2714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636597.196143:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 9 00000100:00100000:0.0:1788636597.196185:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:0.0:1788636597.196195:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:0:x1875521207011584:12345-192.168.202.26@tcp:41: 00000004:00000024:0.0:1788636597.196680:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788636597.196791:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:0:x1875521207011584:12345-192.168.202.26@tcp:41: Request processed in 526us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636597.196799:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:0.0:1788636597.196850:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:0.0:1788636597.196860:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:0:x1875521207011840:12345-192.168.202.26@tcp:41: 00000004:00000024:0.0:1788636597.196888:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636597.196916:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:0:x1875521207011840:12345-192.168.202.26@tcp:41: Request processed in 59us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636597.196923:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:0.0:1788636597.209467:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636597.212858:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207012096 00000100:00100000:2.0:1788636597.212882:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207012096 00000100:00100000:2.0:1788636597.213173:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:2.0:1788636597.213187:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6160:x1875521207012096:12345-192.168.202.26@tcp:40: 00000100:00100000:2.0:1788636597.214906:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6160:x1875521207012096:12345-192.168.202.26@tcp:40: Request processed in 1704us (5438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636597.214922:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:1.0:1788636597.230449:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636597.233229:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636597.233594:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207012224 00000100:00100000:3.0:1788636597.233610:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207012224 00000100:00100000:3.0:1788636597.233687:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:3.0:1788636597.233699:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875521207012224:12345-192.168.202.26@tcp:8: 00010000:00080000:3.0:1788636597.233801:0:9845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:3.0:1788636597.233902:0:9845:0:(genops.c:1385:class_connect()) connect: client a3091a46-1ad5-4415-b7a7-5e4bfab40689, cookie 0x5b741ef42e838216 00002000:00100000:3.0:1788636597.233922:0:9845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a3091a46-1ad5-4415-b7a7-5e4bfab40689/ffff9cef034cd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788636597.233940:0:9845:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788636597.234310:0:9845:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788636597.234357:0:9845:0:(import.c:65:import_set_state_nolock()) ffff9cef034cb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636597.234465:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2397:x1875521207012224:12345-192.168.202.26@tcp:8: Request processed in 765us (4034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636597.234475:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:1.0:1788636597.234844:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636597.234877:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636597.234922:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636597.234948:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207012736 00000100:00100000:1.0:1788636597.234955:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207012736 00000100:00100000:1.0:1788636597.235003:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 4 00000100:00100000:1.0:1788636597.235015:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6160:x1875521207012736:12345-192.168.202.26@tcp:900: 00000100:00100000:1.0:1788636597.235091:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6160:x1875521207012736:12345-192.168.202.26@tcp:900: Request processed in 79us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636597.235100:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 4 00000100:00100000:1.0:1788636597.235179:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207012480 00000100:00100000:1.0:1788636597.235183:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207012480 00000100:00100000:1.0:1788636597.235215:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 198 00000100:00100000:1.0:1788636597.235222:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207012480:12345-192.168.202.26@tcp:400: 00000100:00100000:1.0:1788636597.235255:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207012480:12345-192.168.202.26@tcp:400: Request processed in 33us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636597.235262:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 198 00000100:00100000:2.0:1788636597.237007:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207012352 00000100:00100000:2.0:1788636597.237026:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207012352 00000100:00100000:2.0:1788636597.237115:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:2.0:1788636597.237125:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2397:x1875521207012352:12345-192.168.202.26@tcp:8: 00010000:00080000:2.0:1788636597.237170:0:9847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:2.0:1788636597.237214:0:9847:0:(genops.c:1385:class_connect()) connect: client a3091a46-1ad5-4415-b7a7-5e4bfab40689, cookie 0x5b741ef42e83821d 00002000:00100000:2.0:1788636597.237231:0:9847:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a3091a46-1ad5-4415-b7a7-5e4bfab40689/ffff9cef033a3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788636597.237257:0:9847:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788636597.237916:0:9847:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788636597.237970:0:9847:0:(import.c:65:import_set_state_nolock()) ffff9cef033a3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636597.238077:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2397:x1875521207012352:12345-192.168.202.26@tcp:8: Request processed in 950us (3231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636597.238088:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:1.0:1788636597.243574:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636597.244186:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207012864 00000100:00100000:3.0:1788636597.244201:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207012864 00000100:00100000:3.0:1788636597.244280:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 0 00000100:00100000:3.0:1788636597.244292:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6160:x1875521207012864:12345-192.168.202.26@tcp:33: 00000100:00100000:0.0:1788636597.246147:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207012608 00000100:00100000:0.0:1788636597.246165:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207012608 00000100:00100000:0.0:1788636597.246267:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00100000:0.0:1788636597.246281:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207012608:12345-192.168.202.26@tcp:400: 00000100:00100000:0.0:1788636597.248136:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207012608:12345-192.168.202.26@tcp:400: Request processed in 933us (13996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636597.248154:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 55 00000004:00080000:3.0:1788636597.290904:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 45711us 00000004:00200000:1.0:1788636597.348483:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788636597.348700:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6160:x1875521207012864:12345-192.168.202.26@tcp:33: Request processed in 104397us (105145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636597.348724:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 0 00000100:00100000:1.0:1788636597.563786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636597.566356:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207012992 00000100:00100000:2.0:1788636597.566382:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207012992 00000100:00100000:2.0:1788636597.566497:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:2.0:1788636597.566513:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6203:x1875521207012992:12345-192.168.202.26@tcp:101: 00010000:00010000:2.0:1788636597.566545:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636597.566798:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015ece600/0x5b741ef42e838224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38ec5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636597.566983:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83822b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636597.567000:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83822b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636597.567018:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83822b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636597.567106:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788636597.567111:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636597.567132:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83822b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636597.567168:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015ece600/0x5b741ef42e838224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ec5 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636597.567195:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83822b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ec5 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636597.567206:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf0029e2f00) 00010000:00010000:2.0:1788636597.567209:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636597.567214:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0400, rc 0) 00000100:00100000:2.0:1788636597.567439:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:6203:x1875521207012992:12345-192.168.202.26@tcp:101: Request processed in 928us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636597.567448:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 13 00010000:00010000:3.0:1788636597.654269:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636597.909132:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225938048:0@lo:41: 00000100:00100000:2.0:1788636597.909222:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636597.909401:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225938048 00000100:00100000:1.0:1788636597.909411:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225938048 00000100:00100000:1.0:1788636597.909483:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788636597.909493:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225938048:12345-0@lo:41: 00000004:00000024:1.0:1788636597.909535:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788636597.913088:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225938048:12345-0@lo:41: Request processed in 3578us (3849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636597.913130:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788636597.913671:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225938048:0@lo:41: 00010000:00010000:3.0:1788636598.677036:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636599.445790:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636599.445832:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225938176:0@lo:13: 00000100:00100000:2.0:1788636599.445907:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636599.446418:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225938176 00000100:00100000:3.0:1788636599.446428:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225938176 00000100:00100000:3.0:1788636599.446516:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636599.446527:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225938176:12345-0@lo:13: 00002000:00000024:3.0:1788636599.446562:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636599.446633:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225938176:12345-0@lo:13: Request processed in 108us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636599.446641:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636599.446778:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225938688:0@lo:400: 00000100:00100000:3.0:1788636599.446851:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636599.446871:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225939200:0@lo:400: 00000100:00100000:3.0:1788636599.446896:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636599.446922:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225939712:0@lo:400: 00000100:00100000:3.0:1788636599.446943:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636599.446998:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788636599.447004:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225938560:0@lo:400: 00000100:00100000:3.0:1788636599.447032:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636599.447051:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225939072:0@lo:400: 00000100:00100000:3.0:1788636599.447071:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636599.447084:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225939584:0@lo:400: 00000100:00100000:3.0:1788636599.447124:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636599.447154:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225939200 00000100:00100000:3.0:1788636599.447160:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225939200 00000100:00100000:3.0:1788636599.447199:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225939712 00000100:00100000:3.0:1788636599.447202:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225939712 00000100:00100000:3.0:1788636599.447229:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636599.447236:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225939200:12345-0@lo:400: 00000100:00100000:3.0:1788636599.447275:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225939200:12345-0@lo:400: Request processed in 39us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636599.447281:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636599.447294:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788636599.447300:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225939712:12345-0@lo:400: 00000100:00100000:3.0:1788636599.447325:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225939712:12345-0@lo:400: Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636599.447332:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788636599.447354:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225938560 00000100:00100000:3.0:1788636599.447357:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225938560 00000100:00100000:3.0:1788636599.447382:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788636599.447387:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225938560:12345-0@lo:400: 00000100:00100000:3.0:1788636599.447418:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225938560:12345-0@lo:400: Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636599.447433:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788636599.447483:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225938560:0@lo:400: 00010000:00080000:3.0:1788636599.447497:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03519180 x1875521225939200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636599.447507:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225939200:0@lo:400: 00010000:00080000:3.0:1788636599.447516:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03519c00 x1875521225939712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636599.447524:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225939712:0@lo:400: 00000100:00080000:0.0:1788636599.447988:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636599.447994:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636599.448008:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225938688 00000100:00100000:0.0:1788636599.448013:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225938688 00000100:00100000:0.0:1788636599.448041:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225939072 00000100:00100000:0.0:1788636599.448043:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225939072 00000100:00100000:0.0:1788636599.448069:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225939584 00000100:00100000:0.0:1788636599.448072:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225939584 00000100:00100000:0.0:1788636599.448086:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788636599.448092:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225938688:12345-0@lo:400: 00000100:00100000:0.0:1788636599.448137:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225938688:12345-0@lo:400: Request processed in 46us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636599.448142:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788636599.448155:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636599.448159:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225939072:12345-0@lo:400: 00000100:00100000:0.0:1788636599.448183:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225939072:12345-0@lo:400: Request processed in 24us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636599.448188:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636599.448198:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788636599.448204:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225939584:12345-0@lo:400: 00000100:00100000:0.0:1788636599.448229:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225939584:12345-0@lo:400: Request processed in 26us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636599.448234:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788636599.448264:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03519880 x1875521225939072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636599.448274:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225939072:0@lo:400: 00010000:00080000:0.0:1788636599.448284:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0351a300 x1875521225939584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636599.448302:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225939584:0@lo:400: 00000100:00100000:0.0:1788636599.448316:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225938688:0@lo:400: 00000100:00100000:1.0:1788636599.448507:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225938432:0@lo:400: 00000100:00100000:1.0:1788636599.448546:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636599.448578:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225938944:0@lo:400: 00000100:00100000:1.0:1788636599.448598:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636599.448608:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225939456:0@lo:400: 00000100:00100000:1.0:1788636599.448638:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636599.448653:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788636599.448659:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225938304:0@lo:400: 00000100:00100000:1.0:1788636599.448686:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636599.448709:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225938816:0@lo:400: 00000100:00100000:1.0:1788636599.448732:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636599.448752:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225939328:0@lo:400: 00000100:00100000:1.0:1788636599.448774:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636599.448789:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225939840:0@lo:13: 00000100:00100000:1.0:1788636599.448843:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636599.448873:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225938432 00000100:00100000:1.0:1788636599.448878:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225938432 00000100:00100000:1.0:1788636599.448901:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225938944 00000100:00100000:1.0:1788636599.448904:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225938944 00000100:00100000:1.0:1788636599.448917:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225939456 00000100:00100000:1.0:1788636599.448919:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225939456 00000100:00100000:1.0:1788636599.448933:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788636599.448939:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225938432:12345-0@lo:400: 00000100:00100000:1.0:1788636599.449004:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225938432:12345-0@lo:400: Request processed in 64us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636599.449021:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788636599.449036:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788636599.449043:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225938944:12345-0@lo:400: 00000100:00100000:1.0:1788636599.449074:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225938944:12345-0@lo:400: Request processed in 32us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636599.449079:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788636599.449091:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788636599.449097:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225939456:12345-0@lo:400: 00000100:00100000:1.0:1788636599.449143:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225939456:12345-0@lo:400: Request processed in 47us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636599.449149:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788636599.449170:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225938816 00000100:00100000:1.0:1788636599.449174:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225938816 00000100:00100000:1.0:1788636599.449203:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788636599.449209:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225938816:12345-0@lo:400: 00000100:00100000:1.0:1788636599.449240:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225938816:12345-0@lo:400: Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636599.449246:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788636599.449264:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225939328 00000100:00100000:1.0:1788636599.449268:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225939328 00000100:00100000:1.0:1788636599.449296:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788636599.449301:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225939328:12345-0@lo:400: 00000100:00100000:1.0:1788636599.449333:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225939328:12345-0@lo:400: Request processed in 32us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636599.449338:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788636599.449359:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225939840 00000100:00100000:1.0:1788636599.449368:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225939840 00000100:00080000:3.0:1788636599.453886:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636599.453900:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636599.453904:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636599.454020:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225938816:0@lo:400: 00010000:00080000:3.0:1788636599.454038:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0351bb80 x1875521225939328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636599.454049:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225939328:0@lo:400: 00000100:00100000:3.0:1788636599.454063:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225938432:0@lo:400: 00000100:00100000:3.0:1788636599.454074:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225938944:0@lo:400: 00000100:00100000:3.0:1788636599.454085:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225939456:0@lo:400: 00000100:00100000:1.0:1788636599.454829:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788636599.454843:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225939840:12345-0@lo:13: 00002000:00000024:1.0:1788636599.454872:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636599.454985:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225939840:12345-0@lo:13: Request processed in 137us (6133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636599.454992:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788636599.455103:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225938304 00000100:00100000:2.0:1788636599.455112:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225938304 00000100:00100000:2.0:1788636599.455149:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788636599.455156:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521225938304:12345-0@lo:400: 00000100:00100000:2.0:1788636599.455216:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521225938304:12345-0@lo:400: Request processed in 61us (6529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636599.455223:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:2.0:1788636599.455276:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf040992300 x1875521225938176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636599.455293:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225938176:0@lo:13: 00000100:00100000:3.0:1788636599.455448:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225938304:0@lo:400: 00010000:00080000:3.0:1788636599.455461:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0337ed80 x1875521225939840/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636599.455473:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225939840:0@lo:13: 00010000:00010000:0.0:1788636599.705104:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636599.940981:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636599.941222:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207013120 00000100:00100000:1.0:1788636599.941237:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207013120 00000100:00100000:1.0:1788636599.941335:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00100000:1.0:1788636599.941349:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:6255:x1875521207013120:12345-192.168.202.26@tcp:41: 00000004:00000024:1.0:1788636599.941407:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788636599.941501:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:6255:x1875521207013120:12345-192.168.202.26@tcp:41: Request processed in 155us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636599.941508:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00080000:3.0:1788636599.941578:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636599.947681:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636599.947869:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207013248 00000100:00100000:0.0:1788636599.947886:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207013248 00000100:00100000:0.0:1788636599.948239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 15 00000100:00100000:0.0:1788636599.948254:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6255:x1875521207013248:12345-192.168.202.26@tcp:41: 00000004:00000024:0.0:1788636599.948310:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636599.948505:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6255:x1875521207013248:12345-192.168.202.26@tcp:41: Request processed in 254us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636599.948513:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 15 00000100:00080000:3.0:1788636599.949105:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636599.962892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636599.963003:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207013376 00000100:00100000:3.0:1788636599.963018:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207013376 00000100:00100000:3.0:1788636599.963287:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:3.0:1788636599.963300:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6255:x1875521207013376:12345-192.168.202.26@tcp:13: 00002000:00000024:3.0:1788636599.963342:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636599.963426:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:6255:x1875521207013376:12345-192.168.202.26@tcp:13: Request processed in 129us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636599.963435:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00080000:1.0:1788636599.964555:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788636599.970390:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000100:00100000:2.0:1788636599.978984:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636599.979852:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207013504 00000100:00100000:3.0:1788636599.979868:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207013504 00000100:00100000:3.0:1788636599.980044:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:3.0:1788636599.980055:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:6255:x1875521207013504:12345-192.168.202.26@tcp:13: 00002000:00000024:3.0:1788636599.980095:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636599.980193:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:6255:x1875521207013504:12345-192.168.202.26@tcp:13: Request processed in 140us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636599.980201:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00080000:1.0:1788636599.988708:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788636600.725152:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636601.759014:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636602.006355:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636602.006389:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225939968:0@lo:41: 00000100:00100000:2.0:1788636602.006484:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636602.006576:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225939968 00000100:00100000:2.0:1788636602.006587:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225939968 00000100:00100000:2.0:1788636602.006644:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788636602.006655:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225939968:12345-0@lo:41: 00000004:00000024:2.0:1788636602.006701:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636602.006756:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225939968:12345-0@lo:41: Request processed in 103us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636602.006765:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788636602.006842:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225939968:0@lo:41: 00000100:00100000:2.0:1788636602.006959:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225940096:0@lo:13: 00000100:00100000:2.0:1788636602.006990:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636602.007174:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636602.007182:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225940224:0@lo:13: 00000100:00100000:2.0:1788636602.007206:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636602.007966:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225940096 00000100:00100000:0.0:1788636602.007978:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225940096 00000100:00100000:0.0:1788636602.008024:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225940224 00000100:00100000:0.0:1788636602.008027:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225940224 00000100:00100000:0.0:1788636602.008047:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788636602.008057:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225940096:12345-0@lo:13: 00002000:00000024:0.0:1788636602.008089:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636602.008157:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225940096:12345-0@lo:13: Request processed in 101us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636602.008165:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788636602.008180:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788636602.008187:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225940224:12345-0@lo:13: 00002000:00000024:0.0:1788636602.008198:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636602.008235:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225940224:12345-0@lo:13: Request processed in 49us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636602.008243:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788636602.008367:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636602.008832:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc73100 x1875521225940224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636602.008855:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225940224:0@lo:13: 00010000:00080000:1.0:1788636602.008870:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc71f80 x1875521225940096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636602.008907:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225940096:0@lo:13: 00000001:00100000:2.0:1788636602.010181:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000001:00100000:0.0:1788636602.010196:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000100:00100000:1.0:1788636602.503496:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636602.503584:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636602.503623:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636602.503650:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636602.503679:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636602.503720:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207014016 00000100:00100000:1.0:1788636602.503733:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207014016 00000100:00100000:1.0:1788636602.503800:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207014144 00000100:00100000:1.0:1788636602.503803:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207014144 00000100:00100000:1.0:1788636602.503845:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:1.0:1788636602.503857:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207014016:12345-192.168.202.26@tcp:400: 00000100:00100000:1.0:1788636602.503964:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207014016:12345-192.168.202.26@tcp:400: Request processed in 109us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636602.503973:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:1.0:1788636602.503993:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:1.0:1788636602.504000:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207014144:12345-192.168.202.26@tcp:400: 00000100:00100000:1.0:1788636602.504029:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207014144:12345-192.168.202.26@tcp:400: Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636602.504036:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:1.0:1788636602.504055:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207013760 00000100:00100000:1.0:1788636602.504059:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207013760 00000100:00100000:1.0:1788636602.504084:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207013888 00000100:00100000:1.0:1788636602.504087:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207013888 00000100:00100000:1.0:1788636602.504102:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:1.0:1788636602.504108:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207013760:12345-192.168.202.26@tcp:400: 00000100:00100000:1.0:1788636602.504137:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207013760:12345-192.168.202.26@tcp:400: Request processed in 30us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636602.504144:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:1.0:1788636602.504168:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:1.0:1788636602.504174:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207013888:12345-192.168.202.26@tcp:400: 00000100:00100000:1.0:1788636602.504199:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207013888:12345-192.168.202.26@tcp:400: Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636602.504204:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00080000:1.0:1788636602.504225:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636602.504229:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636602.504232:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636602.504234:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636602.504932:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207013632 00000100:00100000:3.0:1788636602.504942:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207013632 00000100:00100000:3.0:1788636602.505007:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 200 00000100:00100000:3.0:1788636602.505016:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207013632:12345-192.168.202.26@tcp:400: 00000100:00100000:3.0:1788636602.505075:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207013632:12345-192.168.202.26@tcp:400: Request processed in 61us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636602.505095:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 200 00010000:00010000:0.0:1788636602.776120:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636603.029211:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636603.029253:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225940352:0@lo:41: 00000100:00100000:1.0:1788636603.029350:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636603.029489:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225940352 00000100:00100000:0.0:1788636603.029499:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225940352 00000100:00100000:0.0:1788636603.029564:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788636603.029574:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225940352:12345-0@lo:41: 00000004:00000024:0.0:1788636603.029619:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788636603.029672:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225940352:12345-0@lo:41: Request processed in 99us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636603.029678:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788636603.029773:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225940352:0@lo:41: 00000001:00100000:3.0:1788636603.039447:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000001:02000400:0.0:1788636603.263608:0:10188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788636603.797641:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636604.565265:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225940480:0@lo:13: 00000100:00100000:1.0:1788636604.565374:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636604.565527:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225940480 00000100:00100000:2.0:1788636604.565539:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225940480 00000100:00100000:2.0:1788636604.565733:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788636604.565747:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225940480:12345-0@lo:13: 00002000:00000024:2.0:1788636604.565787:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636604.565887:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225940480:12345-0@lo:13: Request processed in 144us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636604.565896:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788636604.565961:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc70000 x1875521225940480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636604.565981:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225940480:0@lo:13: 00000100:00100000:2.0:1788636604.571366:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225940992:0@lo:400: 00000100:00100000:0.0:1788636604.571950:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225940864:0@lo:400: 00000100:00100000:0.0:1788636604.572016:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636604.572064:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225941376:0@lo:400: 00000100:00100000:0.0:1788636604.572087:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636604.572121:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225941888:0@lo:400: 00000100:00100000:0.0:1788636604.572145:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636604.572196:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225940736:0@lo:400: 00000100:00100000:0.0:1788636604.572232:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636604.572255:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225941248:0@lo:400: 00000100:00100000:0.0:1788636604.572281:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636604.572302:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225941760:0@lo:400: 00000100:00100000:0.0:1788636604.572331:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636604.572367:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788636604.572375:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225940608:0@lo:13: 00000100:00100000:0.0:1788636604.572401:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636604.572422:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225941120:0@lo:400: 00000100:00100000:0.0:1788636604.572444:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636604.572455:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225941632:0@lo:400: 00000100:00100000:0.0:1788636604.572474:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636604.572491:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225942144:0@lo:400: 00000100:00100000:0.0:1788636604.572506:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636604.572539:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225940864 00000100:00100000:0.0:1788636604.572552:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225940864 00000100:00100000:0.0:1788636604.572615:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225941376 00000100:00100000:0.0:1788636604.572618:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225941376 00000100:00080000:1.0:1788636604.573877:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636604.574062:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225941760 00000100:00100000:3.0:1788636604.574074:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225941760 00000100:00100000:3.0:1788636604.574125:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225941632 00000100:00100000:3.0:1788636604.574128:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225941632 00000100:00100000:3.0:1788636604.574148:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225942144 00000100:00100000:3.0:1788636604.574151:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225942144 00000100:00100000:3.0:1788636604.574172:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788636604.574182:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225941760:12345-0@lo:400: 00000100:00100000:3.0:1788636604.574284:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225941760:12345-0@lo:400: Request processed in 103us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636604.574292:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788636604.574310:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636604.574316:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225941632:12345-0@lo:400: 00000100:00100000:3.0:1788636604.574341:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225941632:12345-0@lo:400: Request processed in 26us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636604.574347:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636604.574356:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636604.574361:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225942144:12345-0@lo:400: 00000100:00100000:3.0:1788636604.574384:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225942144:12345-0@lo:400: Request processed in 23us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636604.574390:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636604.574408:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225941248 00000100:00100000:3.0:1788636604.574412:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225941248 00000100:00100000:3.0:1788636604.574436:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788636604.574461:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225941248:12345-0@lo:400: 00000100:00100000:3.0:1788636604.574495:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225941248:12345-0@lo:400: Request processed in 35us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636604.574502:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788636604.574522:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225940736 00000100:00100000:3.0:1788636604.574526:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225940736 00000100:00100000:3.0:1788636604.574552:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788636604.574572:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225940736:12345-0@lo:400: 00000100:00100000:3.0:1788636604.574602:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225940736:12345-0@lo:400: Request processed in 32us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636604.574608:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788636604.574645:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225941888 00000100:00100000:3.0:1788636604.574649:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225941888 00000100:00100000:3.0:1788636604.574669:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225941120 00000100:00100000:3.0:1788636604.574672:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225941120 00000100:00100000:3.0:1788636604.574683:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788636604.574690:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225940864:12345-0@lo:400: 00000100:00100000:3.0:1788636604.574727:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225940864:12345-0@lo:400: Request processed in 37us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636604.574733:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788636604.574745:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788636604.574751:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225941888:12345-0@lo:400: 00000100:00100000:3.0:1788636604.574775:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225941888:12345-0@lo:400: Request processed in 25us (2629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636604.574780:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788636604.574789:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788636604.574794:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225941120:12345-0@lo:400: 00000100:00100000:3.0:1788636604.574863:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225941120:12345-0@lo:400: Request processed in 68us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636604.574870:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788636604.575486:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636604.575493:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636604.575495:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636604.575711:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225940608 00000100:00100000:1.0:1788636604.575719:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225940608 00000100:00100000:1.0:1788636604.575768:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788636604.575778:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225940608:12345-0@lo:13: 00002000:00000024:1.0:1788636604.575834:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636604.575911:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225940608:12345-0@lo:13: Request processed in 135us (3508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636604.576085:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788636604.576094:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225941376:12345-0@lo:400: 00000100:00100000:0.0:1788636604.576137:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225941376:12345-0@lo:400: Request processed in 44us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636604.576144:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788636604.576198:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc70000 x1875521225940608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636604.576223:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225940608:0@lo:13: 00000100:00100000:0.0:1788636604.576242:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225941120:0@lo:400: 00010000:00080000:0.0:1788636604.576256:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc72a00 x1875521225941632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636604.576265:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225941632:0@lo:400: 00010000:00080000:0.0:1788636604.576274:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc71500 x1875521225942144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636604.576298:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225942144:0@lo:400: 00000100:00100000:0.0:1788636604.576311:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225940736:0@lo:400: 00000100:00100000:0.0:1788636604.576326:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225941248:0@lo:400: 00010000:00080000:0.0:1788636604.576339:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc70a80 x1875521225941760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636604.576348:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225941760:0@lo:400: 00000100:00100000:0.0:1788636604.576419:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225940864:0@lo:400: 00000100:00100000:0.0:1788636604.576434:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225941376:0@lo:400: 00000100:00100000:0.0:1788636604.576448:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225941888:0@lo:400: 00000100:00100000:2.0:1788636604.576674:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636604.576732:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521225941504:0@lo:400: 00000100:00100000:2.0:1788636604.576778:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636604.576800:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521225942016:0@lo:400: 00000100:00100000:2.0:1788636604.576852:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636604.576876:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225941504 00000100:00100000:2.0:1788636604.576882:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225941504 00000100:00100000:2.0:1788636604.576912:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225942016 00000100:00100000:2.0:1788636604.576914:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225942016 00000100:00100000:2.0:1788636604.577074:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788636604.577082:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521225941504:12345-0@lo:400: 00000100:00100000:2.0:1788636604.577124:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521225941504:12345-0@lo:400: Request processed in 43us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636604.577130:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788636604.577152:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788636604.577157:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521225942016:12345-0@lo:400: 00000100:00100000:2.0:1788636604.577183:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521225942016:12345-0@lo:400: Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636604.577189:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788636604.577215:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc70e00 x1875521225942016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636604.577225:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521225942016:0@lo:400: 00010000:00080000:2.0:1788636604.577246:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc71c00 x1875521225941504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636604.577254:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521225941504:0@lo:400: 00000100:00100000:0.0:1788636604.577328:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225940992 00000100:00100000:0.0:1788636604.577332:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225940992 00000100:00100000:0.0:1788636604.577366:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788636604.577372:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225940992:12345-0@lo:400: 00000100:00100000:0.0:1788636604.577409:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225940992:12345-0@lo:400: Request processed in 37us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636604.577415:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788636604.577429:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636604.577487:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788636604.577617:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225940992:0@lo:400: 00010000:00010000:2.0:1788636604.822840:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636605.849033:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636606.871505:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636607.132415:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636607.132441:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225942272:0@lo:41: 00000100:00100000:3.0:1788636607.132516:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636607.133756:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225942272 00000100:00100000:0.0:1788636607.133765:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225942272 00000100:00100000:0.0:1788636607.133828:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788636607.133842:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225942272:12345-0@lo:41: 00000004:00000024:0.0:1788636607.133875:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636607.133932:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225942272:12345-0@lo:41: Request processed in 96us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636607.133945:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788636607.134283:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225942272:0@lo:41: 00000100:00100000:0.0:1788636607.142152:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636607.142177:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225942400:0@lo:13: 00000100:00100000:0.0:1788636607.142254:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636607.142317:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225942400 00000100:00100000:0.0:1788636607.142325:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225942400 00000100:00100000:0.0:1788636607.142379:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788636607.142388:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225942400:12345-0@lo:13: 00002000:00000024:0.0:1788636607.142418:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636607.142454:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225942400:12345-0@lo:13: Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636607.142462:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788636607.142491:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636607.142520:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03452300 x1875521225942400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636607.142541:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225942400:0@lo:13: 00000100:00100000:0.0:1788636607.142970:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225942528:0@lo:13: 00000100:00100000:0.0:1788636607.143005:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.143145:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225942528 00000100:00100000:3.0:1788636607.143150:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225942528 00000100:00100000:3.0:1788636607.143183:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788636607.143189:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225942528:12345-0@lo:13: 00002000:00000024:3.0:1788636607.143200:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636607.143228:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225942528:12345-0@lo:13: Request processed in 39us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.143234:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788636607.143325:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636607.143342:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d7800 x1875521225942528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636607.143356:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225942528:0@lo:13: 00000100:00100000:0.0:1788636607.614195:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636607.614239:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636607.614281:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636607.614302:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636607.614328:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636607.614571:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207014528 00000100:00100000:0.0:1788636607.614583:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207014528 00000100:00100000:0.0:1788636607.614643:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207014400 00000100:00100000:0.0:1788636607.614647:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207014400 00000100:00100000:0.0:1788636607.614664:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:0.0:1788636607.614674:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207014528:12345-192.168.202.26@tcp:400: 00000100:00100000:0.0:1788636607.614756:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207014528:12345-192.168.202.26@tcp:400: Request processed in 83us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636607.614764:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:0.0:1788636607.614779:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:0.0:1788636607.614785:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207014400:12345-192.168.202.26@tcp:400: 00000100:00100000:0.0:1788636607.614831:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207014400:12345-192.168.202.26@tcp:400: Request processed in 46us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636607.614838:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:0.0:1788636607.614855:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207014784 00000100:00100000:0.0:1788636607.614858:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207014784 00000100:00100000:0.0:1788636607.614879:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207014656 00000100:00100000:0.0:1788636607.614881:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207014656 00000100:00100000:0.0:1788636607.614898:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:0.0:1788636607.614903:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207014784:12345-192.168.202.26@tcp:400: 00000100:00100000:0.0:1788636607.614924:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207014784:12345-192.168.202.26@tcp:400: Request processed in 21us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636607.614930:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:0.0:1788636607.614939:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:0.0:1788636607.614951:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207014656:12345-192.168.202.26@tcp:400: 00000100:00100000:0.0:1788636607.614970:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207014656:12345-192.168.202.26@tcp:400: Request processed in 19us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636607.614976:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00080000:0.0:1788636607.614997:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636607.615001:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636607.615003:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636607.615005:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636607.615542:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207014272 00000100:00100000:1.0:1788636607.615549:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207014272 00000100:00100000:1.0:1788636607.615597:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 202 00000100:00100000:1.0:1788636607.615606:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207014272:12345-192.168.202.26@tcp:400: 00000100:00100000:1.0:1788636607.615648:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207014272:12345-192.168.202.26@tcp:400: Request processed in 43us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636607.615654:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 202 00010000:00010000:2.0:1788636607.893287:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788636607.910507:0:10335:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebf26d6b0 20000000:00000080:0.0:1788636607.910529:0:10335:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cef03454800 uarg=0000000000000000 20000000:01000000:0.0:1788636607.910581:0:10335:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788636607.910584:0:10335:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788636607.910587:0:10335:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788636607.910592:0:10335:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788636607.910598:0:10335:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788636607.910660:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788636607.910663:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788636607.911363:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788636607.911611:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788636607.911638:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788636607.911649:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1788636607.911657:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788636607.911658:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788636607.913000:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1788636607.913339:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1788636607.913369:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1788636607.913384:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1788636607.913396:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788636607.913398:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788636607.914309:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1788636607.914500:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1788636607.914526:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1788636607.914540:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1788636607.914550:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788636607.914561:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788636607.914992:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788636607.915397:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788636607.915422:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788636607.915438:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1788636607.915447:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788636607.915449:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788636607.915934:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1788636607.916085:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1788636607.916103:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788636607.916116:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:0.0:1788636607.916129:0:10335:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788636607.916150:0:10335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916237:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e8380cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8380c6 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916246:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015ecfe00/0x5b741ef42e8380f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8380f0 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916253:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83812f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916259:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015ecf000/0x5b741ef42e838144 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83813d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916265:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e838152 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83814b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916271:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83816e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838167 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916278:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838198 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838191 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916292:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8381b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8381ad expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916299:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf00153e800/0x5b741ef42e8381de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8381d7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916308:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf000031800/0x5b741ef42e8381ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e55 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916315:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf000031a00/0x5b741ef42e8381f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e5c expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916323:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916365:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf000031a00/0x5b741ef42e8381f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e5c expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916380:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf000031a00/0x5b741ef42e8381f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e5c expref: 9 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.916395:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225942656:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636607.916566:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf000031800/0x5b741ef42e8381ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e55 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916575:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf000031800/0x5b741ef42e8381ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e55 expref: 9 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.916583:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225942784:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636607.916623:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153e800/0x5b741ef42e8381de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8381d7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916632:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153e800/0x5b741ef42e8381de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8381d7 expref: 23 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.916641:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03450700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225942912:0@lo:104: 00000100:00100000:0.0:1788636607.916684:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636607.916766:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8381b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8381ad expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.916775:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8381b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8381ad expref: 23 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.916783:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03453100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943040:0@lo:104: 00000100:00100000:0.0:1788636607.916825:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636607.920931:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e838191 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.920954:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838198 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e838191 expref: 23 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.920969:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03450000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943168:0@lo:104: 00000100:00100000:0.0:1788636607.921035:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636607.921309:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636607.921425:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636607.922250:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225942912 00000100:00100000:3.0:1788636607.922263:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225942912 00000100:00100000:3.0:1788636607.922329:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225943040 00000100:00100000:3.0:1788636607.922332:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225943040 00000100:00100000:3.0:1788636607.922353:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788636607.922364:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:10335:x1875521225942912:12345-0@lo:104: 00010000:00010000:3.0:1788636607.922385:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.922475:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636607.922496:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:10335:x1875521225942912:12345-0@lo:104: Request processed in 133us (5810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.922504:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788636607.922525:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788636607.922532:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:10335:x1875521225943040:12345-0@lo:104: 00010000:00010000:3.0:1788636607.922541:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.922579:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788636607.922584:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:10335:x1875521225943040:12345-0@lo:104: Request processed in 54us (5779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.922590:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788636607.922619:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207014912 00000100:00100000:3.0:1788636607.922624:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207014912 00010000:00010000:3.0:1788636607.922643:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf000031a00/0x5b741ef42e8381f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e5c expref: 10 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636607.922665:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207015040 00000100:00100000:3.0:1788636607.922668:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207015040 00010000:00010000:3.0:1788636607.922679:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf000031800/0x5b741ef42e8381ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e55 expref: 11 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636607.922691:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:3.0:1788636607.922698:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3da5b26b-f5ec-400d-b893-346cfc652707+11:2401:x1875521207014912:12345-192.168.202.26@tcp:103: 00010000:00010000:3.0:1788636607.922719:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636607.922726:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf000031a00/0x5b741ef42e8381f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e5c expref: 11 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.922739:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf000031a00/0x5b741ef42e8381f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e5c expref: 11 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.922768:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636607.922845:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3da5b26b-f5ec-400d-b893-346cfc652707+11:2401:x1875521207014912:12345-192.168.202.26@tcp:103: Request processed in 147us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.922851:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:3.0:1788636607.922896:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:3.0:1788636607.922903:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207015040:12345-192.168.202.26@tcp:103: 00010000:00010000:3.0:1788636607.922910:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636607.922915:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf000031800/0x5b741ef42e8381ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e55 expref: 10 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.922924:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf000031800/0x5b741ef42e8381ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e55 expref: 10 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.922933:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636607.922950:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207015040:12345-192.168.202.26@tcp:103: Request processed in 48us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.922956:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 25 00010000:00010000:3.0:1788636607.922974:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788636607.922981:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.922988:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f400 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636607.922993:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923004:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636607.923023:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636607.923029:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636607.923063:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923070:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636607.923088:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923095:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8381d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8381de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923108:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636607.923111:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923116:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153ec00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636607.923119:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923125:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636607.923131:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636607.923136:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636607.923155:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923161:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636607.923167:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923172:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153ec00/0x5b741ef42e8381ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8381b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923182:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636607.923184:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636607.923186:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636607.923194:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636607.923329:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225943296:0@lo:103: 00000100:00100000:3.0:1788636607.923361:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.923395:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636607.923401:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225943424:0@lo:103: 00000100:00100000:3.0:1788636607.923419:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.923445:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225943296 00000100:00100000:3.0:1788636607.923448:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225943296 00010000:00010000:3.0:1788636607.923465:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153e800/0x5b741ef42e8381de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8381d7 expref: 24 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636607.923477:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225943424 00000100:00100000:3.0:1788636607.923479:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225943424 00010000:00010000:3.0:1788636607.923489:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8381b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8381ad expref: 25 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636607.923501:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636607.923507:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+25:3648:x1875521225943296:12345-0@lo:103: 00010000:00010000:3.0:1788636607.923521:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636607.923526:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153e800/0x5b741ef42e8381de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8381d7 expref: 25 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923534:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153e800/0x5b741ef42e8381de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8381d7 expref: 25 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923545:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636607.923570:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+25:3648:x1875521225943296:12345-0@lo:103: Request processed in 63us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.923576:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636607.923590:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636607.923596:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521225943424:12345-0@lo:103: 00010000:00010000:3.0:1788636607.923603:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636607.923608:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8381b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8381ad expref: 24 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923617:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8381b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8381ad expref: 24 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.923626:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636607.923645:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521225943424:12345-0@lo:103: Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.923651:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636607.923686:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225943424:0@lo:103: 00000100:00100000:3.0:1788636607.923695:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225943296:0@lo:103: 00010000:00010000:0.0:1788636607.924601:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83816e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e838167 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.924616:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83816e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e838167 expref: 23 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.924643:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943552:0@lo:104: 00000100:00100000:0.0:1788636607.924683:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636607.924701:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e838152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83814b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.924721:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e838152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83814b expref: 23 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.924730:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943680:0@lo:104: 00010000:00010000:0.0:1788636607.924755:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015ecf000/0x5b741ef42e838144 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83813d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.924763:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015ecf000/0x5b741ef42e838144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83813d expref: 23 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.924771:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03453b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943808:0@lo:104: 00010000:00010000:0.0:1788636607.924794:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83812f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.924801:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83812f expref: 23 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.924839:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03453480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943936:0@lo:104: 00010000:00010000:0.0:1788636607.924883:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015ecfe00/0x5b741ef42e8380f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8380f0 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.924891:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015ecfe00/0x5b741ef42e8380f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8380f0 expref: 23 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.924910:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225944064:0@lo:104: 00010000:00010000:0.0:1788636607.924936:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e8380cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8380c6 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.924944:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e8380cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8380c6 expref: 23 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.924951:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225944192:0@lo:104: 00000100:00100000:0.0:1788636607.924969:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf009496240 going to sleep for 11 seconds 00010000:00010000:0.0:1788636607.924992:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031a00/0x5b741ef42e8381f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e5c expref: 9 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.925005:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225942656:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636607.925015:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031800/0x5b741ef42e8381ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e55 expref: 8 pid: 6516 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.925023:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225942784:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636607.925034:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153e800/0x5b741ef42e8381de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8381d7 expref: 23 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.925041:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03450700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225942912:0@lo:104: 00010000:00010000:0.0:1788636607.925050:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8381b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8381ad expref: 22 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.925058:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03453100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943040:0@lo:104: 00000100:00100000:3.0:1788636607.925335:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788636607.925354:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.925376:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.925385:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.925393:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.925403:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.925411:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225943168 00000100:00100000:3.0:1788636607.925417:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225943168 00000100:00100000:3.0:1788636607.926425:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225943552 00000100:00100000:3.0:1788636607.926436:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225943552 00000100:00100000:3.0:1788636607.926536:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225943680 00000100:00100000:3.0:1788636607.926541:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225943680 00000100:00100000:3.0:1788636607.926553:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225943808 00000100:00100000:3.0:1788636607.926555:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225943808 00000100:00100000:3.0:1788636607.926565:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225943936 00000100:00100000:3.0:1788636607.926567:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225943936 00000100:00100000:3.0:1788636607.926577:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225944064 00000100:00100000:3.0:1788636607.926580:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225944064 00000100:00100000:3.0:1788636607.926589:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225944192 00000100:00100000:3.0:1788636607.926591:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225944192 00000100:00100000:3.0:1788636607.926606:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636607.926616:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:10335:x1875521225943168:12345-0@lo:104: 00010000:00010000:3.0:1788636607.926637:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.926755:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636607.926762:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03453800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+9:10335:x1875521225943168:12345-0@lo:104: Request processed in 147us (5728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.926770:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636607.926793:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636607.926800:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aa4f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+8:10335:x1875521225943552:12345-0@lo:104: 00000100:00100000:0.0:1788636607.926993:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03450000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943168:0@lo:104: 00010000:00010000:3.0:1788636607.927062:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.927189:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636607.927200:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.927207:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990c00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636607.927212:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.927220:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636607.927228:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636607.927234:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636607.927281:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.927288:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636607.927311:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.927326:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015990c00/0x5b741ef42e838191 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838198 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.927340:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636607.927342:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636607.927344:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636607.927363:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225944320:0@lo:103: 00000100:00100000:1.0:1788636607.927407:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636607.927509:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636607.927516:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aa4f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+8:10335:x1875521225943552:12345-0@lo:104: Request processed in 717us (2833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.927524:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636607.927570:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636607.927579:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+7:10335:x1875521225943680:12345-0@lo:104: 00010000:00010000:3.0:1788636607.927587:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.927624:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788636607.927630:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+7:10335:x1875521225943680:12345-0@lo:104: Request processed in 54us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.927636:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636607.927650:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788636607.927657:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+6:10335:x1875521225943808:12345-0@lo:104: 00010000:00010000:3.0:1788636607.927666:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.927697:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788636607.927703:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+6:10335:x1875521225943808:12345-0@lo:104: Request processed in 48us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.927720:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788636607.927734:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788636607.927740:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:10335:x1875521225943936:12345-0@lo:104: 00010000:00010000:3.0:1788636607.927748:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.927781:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788636607.927787:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:10335:x1875521225943936:12345-0@lo:104: Request processed in 48us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.927793:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788636607.927982:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788636607.927990:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:10335:x1875521225944064:12345-0@lo:104: 00010000:00010000:3.0:1788636607.927999:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.928026:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788636607.928031:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:10335:x1875521225944064:12345-0@lo:104: Request processed in 43us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.928036:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788636607.928049:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788636607.928056:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:10335:x1875521225944192:12345-0@lo:104: 00010000:00010000:3.0:1788636607.928064:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.928090:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788636607.928094:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:10335:x1875521225944192:12345-0@lo:104: Request processed in 40us (2691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.928100:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788636607.928118:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788636607.928123:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.928141:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636607.928145:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.928153:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928331:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788636607.928338:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928345:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990e00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636607.928348:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928355:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636607.928362:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636607.928368:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636607.928390:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928396:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636607.928413:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928432:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e83814b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838152 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928457:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788636607.928461:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928467:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ecfa00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636607.928470:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928476:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636607.928482:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636607.928487:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636607.928502:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928508:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636607.928524:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928532:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015ecfa00/0x5b741ef42e83813d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838144 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928542:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788636607.928552:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928558:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ece800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636607.928561:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928568:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636607.928574:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636607.928579:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636607.928595:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928602:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636607.928607:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928613:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015ece800/0x5b741ef42e83812f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838136 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928622:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636607.928625:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928631:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ecf800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636607.928633:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928651:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636607.928658:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636607.928663:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636607.928677:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928683:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636607.928688:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928695:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf800/0x5b741ef42e8380f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8380f7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928704:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636607.928717:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928723:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ecea00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636607.928726:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928732:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636607.928738:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636607.928749:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636607.928763:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928769:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636607.928773:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928780:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015ecea00/0x5b741ef42e8380c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8380cd expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636607.928789:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636607.928790:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636607.928792:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636607.928948:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225944448:0@lo:103: 00000100:00100000:1.0:1788636607.928997:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636607.929029:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225944960:0@lo:103: 00000100:00100000:1.0:1788636607.929049:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636607.929065:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636607.929071:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225944832:0@lo:103: 00000100:00100000:1.0:1788636607.929093:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636607.929204:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225944320 00000100:00100000:2.0:1788636607.929216:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225944320 00010000:00010000:2.0:1788636607.929251:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838198 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838191 expref: 22 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636607.929271:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225944448 00000100:00100000:2.0:1788636607.929274:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225944448 00010000:00010000:2.0:1788636607.929285:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e838152 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83814b expref: 23 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636607.929295:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225944960 00000100:00100000:2.0:1788636607.929297:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225944960 00010000:00010000:2.0:1788636607.929307:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e8380cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8380c6 expref: 24 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636607.929326:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225944832 00000100:00100000:2.0:1788636607.929329:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225944832 00010000:00010000:2.0:1788636607.929341:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015ecfe00/0x5b741ef42e8380f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8380f0 expref: 25 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636607.929352:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788636607.929359:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03653800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+25:3646:x1875521225944320:12345-0@lo:103: 00010000:00010000:2.0:1788636607.929370:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636607.929376:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838198 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838191 expref: 25 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636607.929388:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838198 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e838191 expref: 25 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636607.929402:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e838198 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e838191 expref: 25 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636607.929416:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636607.931001:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03653800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225944320:12345-0@lo:103: Request processed in 1632us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636607.931014:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788636607.931048:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788636607.931058:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:3647:x1875521225944448:12345-0@lo:103: 00010000:00010000:2.0:1788636607.931072:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636607.931079:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e838152 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83814b expref: 23 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636607.931091:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e838152 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83814b expref: 23 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636607.931118:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636607.931173:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:3647:x1875521225944448:12345-0@lo:103: Request processed in 107us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636607.931179:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788636607.931194:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788636607.931200:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03652a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:3647:x1875521225944960:12345-0@lo:103: 00010000:00010000:2.0:1788636607.931209:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636607.931213:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e8380cd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8380c6 expref: 22 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636607.931221:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e8380cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8380c6 expref: 22 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636607.931229:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636607.931251:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03652a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:3647:x1875521225944960:12345-0@lo:103: Request processed in 51us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636607.931257:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788636607.931269:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636607.931275:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3647:x1875521225944832:12345-0@lo:103: 00010000:00010000:2.0:1788636607.931282:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636607.931286:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015ecfe00/0x5b741ef42e8380f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8380f0 expref: 21 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636607.931293:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015ecfe00/0x5b741ef42e8380f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8380f0 expref: 21 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636607.931303:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636607.931329:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3647:x1875521225944832:12345-0@lo:103: Request processed in 55us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636607.931336:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636607.931402:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225944832:0@lo:103: 00000100:00100000:2.0:1788636607.931412:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225944448:0@lo:103: 00000100:00100000:2.0:1788636607.931419:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225944960:0@lo:103: 00000100:00100000:2.0:1788636607.931601:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225944320:0@lo:103: 10000000:00010000:3.0:1788636607.931923:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636607.931929:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636607.931959:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.931964:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636607.931971:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.931978:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e838167 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83816e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.931994:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636607.931995:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636607.931998:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636607.932010:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225944704:0@lo:103: 00000100:00100000:3.0:1788636607.932045:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.932072:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788636607.932078:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225944576:0@lo:103: 00000100:00100000:3.0:1788636607.932108:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.932117:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225945088:0@lo:103: 00000100:00100000:3.0:1788636607.932131:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636607.932176:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225944704 00000100:00100000:3.0:1788636607.932182:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225944704 00010000:00010000:3.0:1788636607.932205:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838136 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83812f expref: 21 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636607.932220:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225944576 00000100:00100000:3.0:1788636607.932222:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225944576 00010000:00010000:3.0:1788636607.932231:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015ecf000/0x5b741ef42e838144 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83813d expref: 22 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636607.932239:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225945088 00000100:00100000:3.0:1788636607.932241:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225945088 00010000:00010000:3.0:1788636607.932248:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83816e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838167 expref: 23 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636607.932258:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788636607.932263:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:3649:x1875521225944704:12345-0@lo:103: 00010000:00010000:3.0:1788636607.932271:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636607.932275:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838136 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83812f expref: 23 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.932283:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83812f expref: 23 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.932293:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636607.932321:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:3649:x1875521225944704:12345-0@lo:103: Request processed in 58us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.932335:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788636607.932999:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788636607.933010:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:3649:x1875521225944576:12345-0@lo:103: 00010000:00010000:3.0:1788636607.933019:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636607.933024:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015ecf000/0x5b741ef42e838144 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83813d expref: 22 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933033:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015ecf000/0x5b741ef42e838144 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83813d expref: 22 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933044:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636607.933072:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:3649:x1875521225944576:12345-0@lo:103: Request processed in 67us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.933079:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788636607.933091:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788636607.933097:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3649:x1875521225945088:12345-0@lo:103: 00010000:00010000:3.0:1788636607.933104:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636607.933107:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83816e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838167 expref: 21 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933116:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83816e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e838167 expref: 21 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933127:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933136:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933521:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933530:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933537:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933544:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933550:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7200 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636607.933554:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933562:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933571:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636607.933582:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636607.933608:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3649:x1875521225945088:12345-0@lo:103: Request processed in 511us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636607.933614:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788636607.933654:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225944576:0@lo:103: 00000100:00100000:3.0:1788636607.933662:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225945088:0@lo:103: 00000100:00100000:3.0:1788636607.933669:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225944704:0@lo:103: 00010000:00010000:3.0:1788636607.933700:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636607.935331:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153e400/0x5b741ef42e83816e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e838167 expref: 20 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.935350:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943552:0@lo:104: 00010000:00010000:0.0:1788636607.935385:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153fa00/0x5b741ef42e838152 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83814b expref: 19 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.935395:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943680:0@lo:104: 00010000:00010000:0.0:1788636607.935406:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ecf000/0x5b741ef42e838144 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83813d expref: 18 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.935415:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03453b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943808:0@lo:104: 00010000:00010000:0.0:1788636607.935425:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153e000/0x5b741ef42e838136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83812f expref: 17 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.935432:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03453480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225943936:0@lo:104: 00010000:00010000:0.0:1788636607.935442:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ecfe00/0x5b741ef42e8380f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8380f0 expref: 16 pid: 6516 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.936070:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225944064:0@lo:104: 00010000:00010000:0.0:1788636607.936092:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ecec00/0x5b741ef42e8380cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8380c6 expref: 15 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636607.936103:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875521225944192:0@lo:104: 00010000:00010000:0.0:1788636607.936149:0:10335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.936174:0:10335:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.936200:0:10335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636607.936206:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e838232 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636608.149025:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636608.149055:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225945216:0@lo:41: 00000100:00100000:2.0:1788636608.149128:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636608.149243:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225945216 00000100:00100000:1.0:1788636608.149254:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225945216 00000100:00100000:1.0:1788636608.149311:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788636608.149321:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225945216:12345-0@lo:41: 00000004:00000024:1.0:1788636608.149357:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788636608.149408:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225945216:12345-0@lo:41: Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636608.149429:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788636608.149476:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225945216:0@lo:41: 00010000:00010000:1.0:1788636608.918168:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788636609.492971:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788636609.492984:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf03a765800 from 48 10000000:01000000:3.0:1788636609.492992:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788636609.493059:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.493073:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.493087:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636609.493116:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225945344:0@lo:101: 00000100:00100000:3.0:1788636609.493194:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.493284:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397480 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.493499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225945344 00000100:00100000:0.0:1788636609.493510:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225945344 00000100:00100000:0.0:1788636609.493582:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788636609.493593:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+15:6519:x1875521225945344:12345-0@lo:101: 00010000:00010000:0.0:1788636609.493608:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636609.493626:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6600/0x5b741ef42e838240 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838239 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.493654:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6600/0x5b741ef42e838240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838239 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.493678:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6600/0x5b741ef42e838240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838239 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.493689:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6600, rc 0) 00000100:00100000:0.0:1788636609.493754:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225945344:12345-0@lo:101: Request processed in 162us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.493761:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788636609.494061:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225945344:0@lo:101: 00010000:00010000:3.0:1788636609.494080:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.494090:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636609.494163:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225945472:0@lo:501: 00000100:00100000:3.0:1788636609.494194:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.494225:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397480 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.494383:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225945472 00000100:00100000:0.0:1788636609.494388:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225945472 00000100:00100000:0.0:1788636609.494422:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788636609.494431:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225945472:12345-0@lo:501: 00000100:00100000:0.0:1788636609.494979:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225945472:12345-0@lo:501: Request processed in 548us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.494987:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788636609.497265:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225945472:0@lo:501: 00000100:00100000:1.0:1788636609.497330:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225945600:0@lo:503: 00000100:00100000:1.0:1788636609.497414:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.497617:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636609.501275:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225945600 00000100:00100000:2.0:1788636609.501291:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225945600 00000100:00100000:2.0:1788636609.501450:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788636609.501464:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225945600:12345-0@lo:503: 00000100:00100000:2.0:1788636609.502639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225945600:12345-0@lo:503: Request processed in 1173us (5220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636609.502651:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788636609.502793:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225945600:0@lo:503: 00000100:00100000:1.0:1788636609.503515:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10353:1875521225945728:0@lo:502: 00000100:00100000:1.0:1788636609.503569:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.506930:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636609.507304:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225945728 00000100:00100000:3.0:1788636609.507313:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225945728 00000100:00100000:3.0:1788636609.507363:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788636609.507387:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:10353:x1875521225945728:12345-0@lo:502: 00000100:00100000:3.0:1788636609.507564:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:10353:x1875521225945728:12345-0@lo:502: Request processed in 179us (3994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636609.507573:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788636609.507842:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10353:1875521225945728:0@lo:502: 00000100:00100000:1.0:1788636609.507902:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10353:1875521225945856:0@lo:502: 00000100:00100000:1.0:1788636609.507958:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.507986:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636609.508455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225945856 00000100:00100000:3.0:1788636609.508462:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225945856 00000100:00100000:3.0:1788636609.508509:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788636609.508519:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:10353:x1875521225945856:12345-0@lo:502: 00000100:00100000:3.0:1788636609.508621:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:10353:x1875521225945856:12345-0@lo:502: Request processed in 104us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636609.508627:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788636609.508784:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10353:1875521225945856:0@lo:502: 00000040:00080000:1.0:1788636609.508832:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788636609.510090:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788636609.510123:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788636609.510133:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.510147:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636609.510157:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788636609.510160:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788636609.510162:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788636609.510197:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.510206:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.510216:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636609.510245:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225945984:0@lo:101: 00000100:00100000:3.0:1788636609.510303:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.510351:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636609.510956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225945984 00000100:00100000:2.0:1788636609.510965:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225945984 00000100:00100000:2.0:1788636609.511015:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788636609.511025:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+16:6519:x1875521225945984:12345-0@lo:101: 00010000:00010000:2.0:1788636609.511038:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636609.511051:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e83824e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838247 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636609.511368:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e83824e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838247 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636609.511393:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e83824e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838247 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636609.511403:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0000, rc 0) 00000100:00100000:2.0:1788636609.511462:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225945984:12345-0@lo:101: Request processed in 438us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636609.511540:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788636609.511881:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225945984:0@lo:101: 00010000:00010000:3.0:1788636609.511904:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.512216:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636609.512292:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225946112:0@lo:501: 00000100:00100000:3.0:1788636609.512333:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.512457:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636609.517424:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225946112 00000100:00100000:2.0:1788636609.517443:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225946112 00000100:00100000:2.0:1788636609.517613:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788636609.517626:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225946112:12345-0@lo:501: 00000100:00100000:2.0:1788636609.519194:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225946112:12345-0@lo:501: Request processed in 1561us (6850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636609.519210:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788636609.527265:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225946112:0@lo:501: 00000100:00100000:1.0:1788636609.527350:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225946240:0@lo:503: 00000100:00100000:1.0:1788636609.527450:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.527610:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225946240 00000100:00100000:0.0:1788636609.527617:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225946240 00000100:00100000:0.0:1788636609.527693:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788636609.527703:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225946240:12345-0@lo:503: 00000100:00100000:0.0:1788636609.527850:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225946240:12345-0@lo:503: Request processed in 148us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.527858:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788636609.528755:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636609.528783:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225946240:0@lo:503: 00000100:00100000:2.0:1788636609.531510:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10354:1875521225946368:0@lo:502: 00000100:00100000:2.0:1788636609.531613:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636609.531677:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.531846:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225946368 00000100:00100000:0.0:1788636609.531854:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225946368 00000100:00100000:0.0:1788636609.531905:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788636609.531925:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:10354:x1875521225946368:12345-0@lo:502: 00000100:00100000:0.0:1788636609.532059:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:10354:x1875521225946368:12345-0@lo:502: Request processed in 135us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.532067:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788636609.532700:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10354:1875521225946368:0@lo:502: 00000020:01000000:2.0:1788636609.532759:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636609.532772:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636609.532776:0:10354:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788636609.532781:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788636609.532841:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10354:1875521225946496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636609.532891:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636609.532932:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.533079:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225946496 00000100:00100000:0.0:1788636609.533084:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225946496 00000100:00100000:0.0:1788636609.533128:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788636609.533137:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:10354:x1875521225946496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636609.533225:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:10354:x1875521225946496:12345-0@lo:502:llog_process_th.0 Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.533232:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788636609.533646:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10354:1875521225946496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636609.533696:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636609.533701:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636609.533704:0:10354:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788636609.533707:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788636609.534036:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788636609.534074:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788636609.534093:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.534103:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636609.534111:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788636609.534114:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00f1a3000 from 48 10000000:01000000:0.0:1788636609.534116:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788636609.534143:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.534151:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.534160:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636609.534177:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225946624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.534215:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.534246:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00823f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788636609.534374:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225946624 00000100:00100000:2.0:1788636609.534379:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225946624 00000100:00100000:2.0:1788636609.534417:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788636609.534425:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+17:6519:x1875521225946624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636609.534434:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636609.534448:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab0200/0x5b741ef42e83825c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838255 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636609.534545:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab0200/0x5b741ef42e83825c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838255 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636609.534559:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab0200/0x5b741ef42e83825c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838255 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636609.534567:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0200, rc 0) 00000100:00100000:2.0:1788636609.534599:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225946624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636609.534603:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788636609.535670:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225946624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636609.535688:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.535696:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636609.535748:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225946752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.535788:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.535839:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00823f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788636609.535901:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225946752 00000100:00100000:2.0:1788636609.535906:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225946752 00000100:00100000:2.0:1788636609.536021:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788636609.536028:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225946752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636609.536280:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225946752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636609.536293:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788636609.536540:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225946752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.536566:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225946880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.536597:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.536620:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00823f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788636609.536648:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225946880 00000100:00100000:3.0:1788636609.536654:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225946880 00000100:00100000:3.0:1788636609.536702:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788636609.536710:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225946880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.536803:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225946880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.536979:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225946880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.537092:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788636609.537740:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10355:1875521225947008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636609.537795:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.538104:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636609.538708:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225947008 00000100:00100000:2.0:1788636609.538716:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225947008 00000100:00100000:0.0:1788636609.539073:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788636609.539083:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:10355:x1875521225947008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636609.539227:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:10355:x1875521225947008:12345-0@lo:502:llog_process_th.0 Request processed in 145us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.539235:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788636609.539267:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10355:1875521225947008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636609.539350:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10355:1875521225947136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636609.539408:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.539439:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397480 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.539539:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225947136 00000100:00100000:0.0:1788636609.539543:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225947136 00000100:00100000:0.0:1788636609.539566:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788636609.539572:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:10355:x1875521225947136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636609.539634:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:10355:x1875521225947136:12345-0@lo:502:llog_process_th.0 Request processed in 61us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.539641:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788636609.539672:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10355:1875521225947136:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788636609.539696:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788636609.540530:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788636609.540560:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788636609.540573:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.540585:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636609.540595:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788636609.540598:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788636609.540601:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788636609.540635:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.540643:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.540653:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636609.540685:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225947264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.540734:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.540770:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.541238:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225947264 00000100:00100000:0.0:1788636609.541244:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225947264 00000100:00100000:0.0:1788636609.541296:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788636609.541304:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+18:6519:x1875521225947264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636609.541313:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636609.541330:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7c00/0x5b741ef42e83826a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838263 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.541367:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7c00/0x5b741ef42e83826a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838263 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.541377:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7c00/0x5b741ef42e83826a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838263 expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.541385:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7c00, rc 0) 00000100:00100000:0.0:1788636609.541432:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225947264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.541439:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788636609.541527:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225947264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636609.541545:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.541562:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636609.541619:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225947392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.541642:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.541676:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.541714:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225947392 00000100:00100000:0.0:1788636609.541717:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225947392 00000100:00100000:0.0:1788636609.541744:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788636609.541749:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225947392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.541878:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225947392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.541885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788636609.542003:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225947392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.542032:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225947520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.542074:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.542090:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225947520 00000100:00100000:3.0:1788636609.542091:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397480 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.542095:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225947520 00000100:00100000:0.0:1788636609.542122:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788636609.542128:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225947520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.542211:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225947520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.542217:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788636609.542433:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225947520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636609.542881:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10356:1875521225947648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636609.543044:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636609.543087:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.543189:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225947648 00000100:00100000:0.0:1788636609.543194:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225947648 00000100:00100000:0.0:1788636609.543236:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788636609.543244:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:10356:x1875521225947648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636609.543329:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:10356:x1875521225947648:12345-0@lo:502:llog_process_th.0 Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.543335:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788636609.543437:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10356:1875521225947648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636609.543501:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636609.543511:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636609.543514:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788636609.543518:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788636609.543536:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10356:1875521225947776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636609.543563:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636609.543583:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.543718:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225947776 00000100:00100000:0.0:1788636609.543722:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225947776 00000100:00100000:0.0:1788636609.543748:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788636609.543754:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:10356:x1875521225947776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636609.543990:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:10356:x1875521225947776:12345-0@lo:502:llog_process_th.0 Request processed in 235us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.543996:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788636609.544877:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10356:1875521225947776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636609.544934:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636609.544943:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636609.544945:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788636609.544950:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1788636609.547764:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788636609.547801:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788636609.547851:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.547865:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636609.547878:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788636609.547881:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00f150000 from 48 10000000:01000000:3.0:1788636609.547885:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788636609.547927:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.547937:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.547948:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636609.547985:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225947904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.548054:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.548111:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397480 going to sleep for 11 seconds 00000100:00100000:1.0:1788636609.548675:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225947904 00000100:00100000:1.0:1788636609.548684:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225947904 00000100:00100000:1.0:1788636609.548739:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788636609.548748:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:6519:x1875521225947904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636609.548762:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636609.548775:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838278 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838271 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.548799:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838271 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.548850:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838271 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.548859:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015990c00, rc 0) 00000100:00100000:1.0:1788636609.548909:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225947904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.548916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788636609.555690:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225947904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636609.555722:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.555737:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636609.555872:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225948032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.555948:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.556042:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636609.556184:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225948032 00000100:00100000:1.0:1788636609.556192:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225948032 00000100:00100000:1.0:1788636609.556249:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788636609.556273:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225948032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.556641:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225948032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.556651:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788636609.557026:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225948032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.557068:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225948160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.557121:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.557193:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397840 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.557223:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225948160 00000100:00100000:0.0:1788636609.557228:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225948160 00000100:00100000:0.0:1788636609.557298:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788636609.557307:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225948160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.557501:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225948160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.557509:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788636609.557631:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225948160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.558580:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10357:1875521225948288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636609.558633:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.558706:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636609.558736:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225948288 00000100:00100000:1.0:1788636609.558740:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225948288 00000100:00100000:1.0:1788636609.558839:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788636609.558848:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:10357:x1875521225948288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636609.558954:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:10357:x1875521225948288:12345-0@lo:502:llog_process_th.0 Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.558961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788636609.559058:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10357:1875521225948288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636609.559116:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10357:1875521225948416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636609.559150:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.559549:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.559607:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225948416 00000100:00100000:0.0:1788636609.559612:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225948416 00000100:00100000:0.0:1788636609.559636:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788636609.559643:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:10357:x1875521225948416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636609.559729:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:10357:x1875521225948416:12345-0@lo:502:llog_process_th.0 Request processed in 86us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.559736:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788636609.559912:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10357:1875521225948416:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788636609.559946:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788636609.560104:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788636609.560126:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788636609.560138:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.560148:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636609.560158:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788636609.560161:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1788636609.560163:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788636609.560192:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.560200:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.560209:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636609.560235:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225948544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.560266:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.560300:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636609.560342:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225948544 00000100:00100000:3.0:1788636609.560346:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225948544 00000100:00100000:3.0:1788636609.560367:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788636609.560373:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225948544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636609.560382:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636609.560543:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf000031400/0x5b741ef42e838286 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83827f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.560568:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf000031400/0x5b741ef42e838286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83827f expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.560580:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf000031400/0x5b741ef42e838286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83827f expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636609.560590:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000031400, rc 0) 00000100:00100000:3.0:1788636609.560628:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225948544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636609.560635:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788636609.560712:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225948544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636609.560725:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.560735:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636609.560782:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225948672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.560906:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.560923:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636609.561011:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225948672 00000100:00100000:3.0:1788636609.561015:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225948672 00000100:00100000:3.0:1788636609.561033:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788636609.561039:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225948672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.561159:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225948672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636609.561166:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788636609.561234:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225948672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.561258:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225948800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.561292:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.561316:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636609.561357:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225948800 00000100:00100000:3.0:1788636609.561361:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225948800 00000100:00100000:3.0:1788636609.561377:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788636609.561382:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225948800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.561634:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225948800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636609.561641:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788636609.562026:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225948800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.562672:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10358:1875521225948928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636609.562722:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.562786:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.563011:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225948928 00000100:00100000:0.0:1788636609.563017:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225948928 00000100:00100000:0.0:1788636609.563086:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788636609.563095:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:10358:x1875521225948928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636609.563207:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:10358:x1875521225948928:12345-0@lo:502:llog_process_th.0 Request processed in 113us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.563223:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788636609.563288:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10358:1875521225948928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788636609.563324:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636609.563333:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636609.563335:0:10358:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788636609.563341:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788636609.563358:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10358:1875521225949056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636609.563387:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636609.563608:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636609.563669:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225949056 00000100:00100000:1.0:1788636609.563673:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225949056 00000100:00100000:1.0:1788636609.563698:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788636609.563704:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:10358:x1875521225949056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636609.563791:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:10358:x1875521225949056:12345-0@lo:502:llog_process_th.0 Request processed in 86us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.563797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788636609.563974:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10358:1875521225949056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788636609.564003:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636609.564008:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636609.564010:0:10358:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788636609.564013:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788636609.564782:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788636609.564852:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788636609.564862:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.564874:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636609.564885:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788636609.564896:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00324c000 from 48 10000000:01000000:1.0:1788636609.564900:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788636609.564929:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.564938:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.564946:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636609.564963:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225949184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.565006:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.565034:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225949184 00000100:00100000:1.0:1788636609.565038:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225949184 00000100:00100000:1.0:1788636609.565065:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788636609.565072:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225949184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636609.565082:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636609.565096:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015990a00/0x5b741ef42e838294 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83828d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.565118:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015990a00/0x5b741ef42e838294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83828d expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.565129:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015990a00/0x5b741ef42e838294 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83828d expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.565137:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015990a00, rc 0) 00000100:00100000:1.0:1788636609.565165:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225949184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.565180:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788636609.565214:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04097bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636609.565228:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225949184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636609.565242:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.565250:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636609.565293:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225949312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.565314:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.565330:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225949312 00000100:00100000:1.0:1788636609.565333:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225949312 00000100:00100000:1.0:1788636609.565347:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788636609.565352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225949312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.565617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225949312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.565624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788636609.565643:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033ae240 going to sleep for 11 seconds 00000100:00100000:1.0:1788636609.565652:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225949312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.565686:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225949440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.565718:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.565735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225949440 00000100:00100000:1.0:1788636609.565738:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225949440 00000100:00100000:1.0:1788636609.565753:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788636609.565764:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225949440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.565900:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225949440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.565907:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788636609.565942:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033ae240 going to sleep for 11 seconds 00000100:00100000:1.0:1788636609.565953:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225949440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.566999:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10359:1875521225949568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636609.567053:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.567087:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636609.567133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225949568 00000100:00100000:3.0:1788636609.567140:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225949568 00000100:00100000:3.0:1788636609.567176:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788636609.567183:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:10359:x1875521225949568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636609.567312:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:10359:x1875521225949568:12345-0@lo:502:llog_process_th.0 Request processed in 128us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636609.567319:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788636609.567596:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10359:1875521225949568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636609.567650:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10359:1875521225949696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636609.567720:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.567770:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636609.567802:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225949696 00000100:00100000:3.0:1788636609.571617:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225949696 00000100:00100000:3.0:1788636609.571713:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788636609.571725:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:10359:x1875521225949696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636609.572234:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:10359:x1875521225949696:12345-0@lo:502:llog_process_th.0 Request processed in 510us (4511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636609.572249:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788636609.572356:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10359:1875521225949696:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788636609.572569:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788636609.573332:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788636609.573354:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788636609.573365:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.573377:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636609.573387:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788636609.573454:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788636609.573458:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788636609.573562:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.573572:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.573583:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636609.573608:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225949824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.573675:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.573757:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788636609.573800:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225949824 00000100:00100000:2.0:1788636609.573992:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225949824 00000100:00100000:2.0:1788636609.574080:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788636609.574090:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225949824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636609.574105:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636609.574118:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab1600/0x5b741ef42e8382a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83829b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636609.574157:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab1600/0x5b741ef42e8382a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83829b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636609.574167:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab1600/0x5b741ef42e8382a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83829b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636609.574175:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1600, rc 0) 00000100:00100000:2.0:1788636609.574253:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225949824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636609.574260:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788636609.574342:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225949824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636609.574357:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.574368:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636609.574573:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225949952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.574600:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.574637:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636609.574685:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225949952 00000100:00100000:3.0:1788636609.574689:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225949952 00000100:00100000:3.0:1788636609.574721:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788636609.574728:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225949952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636609.575635:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225949952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 904us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636609.575644:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788636609.575759:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225949952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.575793:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225950080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.575857:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.575891:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.575994:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225950080 00000100:00100000:0.0:1788636609.576000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225950080 00000100:00100000:0.0:1788636609.576036:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788636609.576043:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225950080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.576138:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225950080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.576151:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788636609.576300:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225950080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.576846:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10360:1875521225950208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636609.576881:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.576907:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.577002:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225950208 00000100:00100000:0.0:1788636609.577007:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225950208 00000100:00100000:0.0:1788636609.577037:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788636609.577044:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:10360:x1875521225950208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636609.577123:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:10360:x1875521225950208:12345-0@lo:502:llog_process_th.0 Request processed in 79us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.577129:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788636609.577199:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10360:1875521225950208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636609.577228:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636609.577236:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636609.577238:0:10360:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788636609.577242:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788636609.577259:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10360:1875521225950336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636609.577285:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.577307:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636609.577345:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225950336 00000100:00100000:0.0:1788636609.577349:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225950336 00000100:00100000:0.0:1788636609.577372:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788636609.577377:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:10360:x1875521225950336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636609.577437:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:10360:x1875521225950336:12345-0@lo:502:llog_process_th.0 Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.577444:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788636609.577709:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10360:1875521225950336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636609.577731:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636609.577735:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636609.577736:0:10360:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788636609.577740:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788636609.577938:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788636609.577957:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788636609.577966:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.577977:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636609.577986:0:6519:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788636609.577989:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf040b3b380 from 1 10000000:01000000:0.0:1788636609.577991:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788636609.578012:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6a00/0x5b741ef42e8382a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.578025:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6a00/0x5b741ef42e8382a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.578034:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6a00/0x5b741ef42e8382a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636609.578047:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225950464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.578077:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.578104:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788636609.578144:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225950464 00000100:00100000:1.0:1788636609.578148:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225950464 00000100:00100000:1.0:1788636609.578176:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788636609.578182:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225950464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636609.578196:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636609.578207:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf015991a00/0x5b741ef42e8382b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8382a9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.578225:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf015991a00/0x5b741ef42e8382b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8382a9 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.578236:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf015991a00/0x5b741ef42e8382b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8382a9 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636609.578244:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015991a00, rc 0) 00000100:00100000:1.0:1788636609.578310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225950464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.578316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788636609.578621:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225950464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636609.578633:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6a00/0x5b741ef42e8382a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382b0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.578642:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6a00/0x5b741ef42e8382a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8382b0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636609.578694:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225950592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636609.578717:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.578735:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788636609.578774:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225950592 00000100:00100000:1.0:1788636609.578778:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225950592 00000100:00100000:1.0:1788636609.578804:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788636609.581542:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225950592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636609.581685:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225950592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (2966us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788636609.581694:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788636609.581930:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225950592:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788636609.581977:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788636609.581988:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6a00/0x5b741ef42e8382a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382b0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636609.582000:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6a00/0x5b741ef42e8382a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382b0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636609.685316:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636609.685342:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225950720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636609.685616:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.685711:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225950848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636609.685735:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636609.685776:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225950720 00000100:00100000:0.0:1788636609.685783:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225950720 00000100:00100000:0.0:1788636609.685847:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225950848 00000100:00100000:0.0:1788636609.685851:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225950848 00000100:00100000:0.0:1788636609.685870:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788636609.685879:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225950720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636609.685911:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636609.685956:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225950720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.685963:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788636609.685981:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788636609.685986:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225950848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636609.685997:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636609.686020:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225950848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.686025:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788636609.686039:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788636609.686069:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc70e00 x1875521225950848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636609.686086:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225950848:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788636609.686113:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc71c00 x1875521225950720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636609.686124:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225950720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636609.687045:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225951360:0@lo:400:kworker.0 00000100:00100000:1.0:1788636609.687090:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.687114:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225951872:0@lo:400:kworker.0 00000100:00100000:1.0:1788636609.687136:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.687158:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788636609.687164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225951232:0@lo:400:kworker.0 00000100:00100000:1.0:1788636609.687195:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.687205:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225951744:0@lo:400:kworker.0 00000100:00100000:1.0:1788636609.687215:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636609.687233:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225951360 00000100:00100000:1.0:1788636609.687237:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225951360 00000100:00100000:1.0:1788636609.687265:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788636609.687280:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225951360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636609.687323:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225951360:12345-0@lo:400:kworker.0 Request processed in 43us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.687330:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788636609.687351:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225951872 00000100:00100000:1.0:1788636609.687354:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225951872 00000100:00100000:2.0:1788636609.687518:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225950976:0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.687542:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636609.687556:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225951488:0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.687567:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636609.687575:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521225952000:0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.687593:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636609.687606:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788636609.687611:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225951104:0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.687630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636609.687644:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225951616:0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.687674:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636609.687685:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225952128:0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.687708:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636609.687731:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225951104 00000100:00100000:2.0:1788636609.687734:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225951104 00000100:00100000:2.0:1788636609.687765:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788636609.687771:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225951104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.687825:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225951104:12345-0@lo:400:kworker.0 Request processed in 53us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636609.687831:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788636609.687862:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225951104:0@lo:400:kworker.0 00000100:00100000:1.0:1788636609.687996:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225951744 00000100:00100000:1.0:1788636609.688001:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225951744 00000100:00100000:1.0:1788636609.688026:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788636609.688033:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225951872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636609.688064:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03652300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225951872:12345-0@lo:400:kworker.0 Request processed in 32us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.688071:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788636609.688082:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788636609.688088:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225951744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636609.688114:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03653480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225951744:12345-0@lo:400:kworker.0 Request processed in 26us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636609.688119:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788636609.688137:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636609.688159:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03653100 x1875521225951744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636609.688184:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225951744:0@lo:400:kworker.0 00000100:00100000:1.0:1788636609.688197:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225951360:0@lo:400:kworker.0 00010000:00080000:1.0:1788636609.688205:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03650a80 x1875521225951872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636609.688212:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225951872:0@lo:400:kworker.0 00000100:00100000:0.0:1788636609.689618:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225951232 00000100:00100000:0.0:1788636609.689631:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225951232 00000100:00100000:0.0:1788636609.689689:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225950976 00000100:00100000:0.0:1788636609.689693:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225950976 00000100:00100000:0.0:1788636609.689704:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225951488 00000100:00100000:0.0:1788636609.689707:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225951488 00000100:00100000:0.0:1788636609.689738:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225952000 00000100:00100000:0.0:1788636609.689742:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225952000 00000100:00100000:0.0:1788636609.689754:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225951616 00000100:00100000:0.0:1788636609.689756:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225951616 00000100:00100000:0.0:1788636609.689768:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225952128 00000100:00100000:0.0:1788636609.689771:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225952128 00000100:00100000:0.0:1788636609.689789:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788636609.689797:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225951232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636609.689917:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225951232:12345-0@lo:400:kworker.0 Request processed in 121us (2719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.689924:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788636609.689940:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788636609.689945:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225950976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636609.689976:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225950976:12345-0@lo:400:kworker.0 Request processed in 31us (2433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.689982:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788636609.689992:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636609.690000:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225951488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636609.690045:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225951488:12345-0@lo:400:kworker.0 Request processed in 46us (2475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.690051:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636609.690062:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788636609.690068:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521225952000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636609.690096:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521225952000:12345-0@lo:400:kworker.0 Request processed in 29us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.690102:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788636609.690112:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788636609.690119:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225951616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636609.690144:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225951616:12345-0@lo:400:kworker.0 Request processed in 26us (2470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.690150:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788636609.690160:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788636609.690166:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225952128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636609.690192:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225952128:12345-0@lo:400:kworker.0 Request processed in 26us (2482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636609.690197:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788636609.690340:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03652680 x1875521225951616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636609.690358:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225951616:0@lo:400:kworker.0 00010000:00080000:2.0:1788636609.690371:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03651180 x1875521225952128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636609.690379:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225952128:0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.690409:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225950976:0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.690420:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225951488:0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.690430:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521225952000:0@lo:400:kworker.0 00000100:00100000:2.0:1788636609.690472:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225951232:0@lo:400:kworker.0 00000100:00080000:1.0:1788636609.691245:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636609.691253:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788636609.941061:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636610.177343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636610.177954:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207015168 00000100:00100000:2.0:1788636610.177973:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207015168 00000100:00100000:2.0:1788636610.178058:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 245 00000100:00100000:2.0:1788636610.178071:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+8:6174:x1875521207015168:12345-192.168.202.26@tcp:101: 00010000:00010000:2.0:1788636610.178089:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636610.179335:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab1800/0x5b741ef42e8382b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38ecc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636610.179422:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab1800/0x5b741ef42e8382b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ecc expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636610.179437:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab1800/0x5b741ef42e8382b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ecc expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636610.179448:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1800, rc 0) 00000100:00100000:2.0:1788636610.179532:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+9:6174:x1875521207015168:12345-192.168.202.26@tcp:101: Request processed in 1464us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636610.179541:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 245 00000100:00100000:3.0:1788636610.185105:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636610.188460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207015296 00000100:00100000:0.0:1788636610.188487:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207015296 00000100:00100000:0.0:1788636610.188594:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 246 00000100:00100000:0.0:1788636610.188607:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+9:6174:x1875521207015296:12345-192.168.202.26@tcp:501: 00000100:00100000:0.0:1788636610.189370:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+9:6174:x1875521207015296:12345-192.168.202.26@tcp:501: Request processed in 759us (4277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636610.189389:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 246 00000100:00100000:1.0:1788636610.197960:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636610.198536:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207015424 00000100:00100000:2.0:1788636610.198551:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207015424 00000100:00100000:2.0:1788636610.198628:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 247 00000100:00100000:2.0:1788636610.198653:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+9:6174:x1875521207015424:12345-192.168.202.26@tcp:503: 00000100:00100000:2.0:1788636610.200035:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+9:6174:x1875521207015424:12345-192.168.202.26@tcp:503: Request processed in 1385us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636610.200050:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 247 00000100:00100000:1.0:1788636610.204710:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636610.205006:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207015552 00000100:00100000:0.0:1788636610.205020:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207015552 00000100:00100000:0.0:1788636610.205092:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 248 00000100:00100000:0.0:1788636610.205103:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+9:6656:x1875521207015552:12345-192.168.202.26@tcp:502: 00000100:00100000:0.0:1788636610.205357:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+9:6656:x1875521207015552:12345-192.168.202.26@tcp:502: Request processed in 255us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636610.205365:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 248 00000100:00100000:0.0:1788636610.213098:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636610.213502:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207015680 00000100:00100000:1.0:1788636610.213519:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207015680 00000100:00100000:1.0:1788636610.213600:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 249 00000100:00100000:1.0:1788636610.213614:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+9:6656:x1875521207015680:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788636610.214145:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+9:6656:x1875521207015680:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 531us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636610.214155:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 249 00000100:00100000:1.0:1788636610.219733:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636610.220102:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207015808 00000100:00100000:0.0:1788636610.220116:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207015808 00000100:00100000:0.0:1788636610.220207:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 250 00000100:00100000:0.0:1788636610.220220:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+9:6174:x1875521207015808:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636610.220274:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636610.220304:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e8382be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38ed3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636610.220350:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e8382be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ed3 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636610.220367:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e8382be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ed3 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636610.220502:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6e00, rc 0) 00000100:00100000:0.0:1788636610.220597:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:6174:x1875521207015808:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 Request processed in 379us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636610.220605:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 250 00000100:00100000:0.0:1788636610.226331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636610.226582:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207015936 00000100:00100000:2.0:1788636610.226594:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207015936 00000100:00100000:2.0:1788636610.226676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 251 00000100:00100000:2.0:1788636610.226690:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:6174:x1875521207015936:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636610.227020:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:6174:x1875521207015936:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 Request processed in 332us (703us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788636610.227029:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 251 00010000:00010000:3.0:1788636610.971992:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788636611.480173:0:10397:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6cb5b930 20000000:00000080:2.0:1788636611.480209:0:10397:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf03fc9a400 uarg=0000000000000000 20000000:01000000:2.0:1788636611.480265:0:10397:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788636611.480273:0:10397:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788636611.480279:0:10397:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788636611.481174:0:10398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788636611.481371:0:10397:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788636611.484049:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788636611.484098:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788636611.484114:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788636611.484133:0:10397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788636611.484161:0:10397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.484187:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015991200/0x5b741ef42e837f61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f5a expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.484195:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e837f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837f68 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.484202:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015990200/0x5b741ef42e837fc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e837fbc expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.484208:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf015ecfc00/0x5b741ef42e8380e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8380e2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.484237:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e94 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.484247:0:10397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.484300:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e94 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.484320:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e94 expref: 9 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636611.484339:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875521225952256:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636611.487762:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015ecfc00/0x5b741ef42e8380e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8380e2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.487787:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015ecfc00/0x5b741ef42e8380e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8380e2 expref: 23 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636611.487831:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875521225952384:0@lo:104: 00000100:00100000:3.0:1788636611.487926:0:10397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636611.488037:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225952384 00000100:00100000:1.0:1788636611.488048:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225952384 00000100:00100000:1.0:1788636611.488122:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788636611.488135:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:10397:x1875521225952384:12345-0@lo:104: 00010000:00010000:1.0:1788636611.488152:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.488245:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636611.488252:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:10397:x1875521225952384:12345-0@lo:104: Request processed in 121us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636611.488261:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1788636611.488288:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636611.488295:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.488303:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0013a1800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636611.488309:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.488319:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636611.488341:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636611.488349:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636611.488392:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.488399:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636611.488426:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.488434:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0013a1800/0x5b741ef42e8380e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8380e9 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.488467:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636611.488469:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636611.488471:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636611.488489:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225952512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636611.488522:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.488928:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225952512 00000100:00100000:0.0:1788636611.488945:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225952512 00010000:00010000:0.0:1788636611.488973:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015ecfc00/0x5b741ef42e8380e9 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8380e2 expref: 24 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636611.489003:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788636611.489010:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225952512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636611.489022:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636611.489027:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015ecfc00/0x5b741ef42e8380e9 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8380e2 expref: 24 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.489038:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015ecfc00/0x5b741ef42e8380e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8380e2 expref: 24 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.489060:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636611.489089:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225952512:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.489095:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1788636611.489640:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015990200/0x5b741ef42e837fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837fbc expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.489655:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015990200/0x5b741ef42e837fc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837fbc expref: 23 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636611.489667:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875521225952640:0@lo:104: 00000100:00100000:3.0:1788636611.489730:0:10397:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636611.489773:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e837f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837f68 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.489782:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e837f6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837f68 expref: 23 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636611.489790:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875521225952768:0@lo:104: 00010000:00010000:3.0:1788636611.489840:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf015991200/0x5b741ef42e837f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e837f5a expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.489848:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf015991200/0x5b741ef42e837f61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e837f5a expref: 23 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636611.489856:0:10397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875521225952896:0@lo:104: 00000100:00100000:3.0:1788636611.489874:0:10397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636611.489905:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875521225952256:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636611.489918:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ecfc00/0x5b741ef42e8380e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8380e2 expref: 23 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636611.489934:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875521225952384:0@lo:104: 00000100:00100000:0.0:1788636611.490128:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788636611.490149:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.490176:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.490189:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225952640 00000100:00100000:0.0:1788636611.490193:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225952640 00000100:00100000:0.0:1788636611.490222:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225952768 00000100:00100000:0.0:1788636611.490225:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225952768 00000100:00100000:0.0:1788636611.490235:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225952896 00000100:00100000:0.0:1788636611.490237:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225952896 00000100:00100000:0.0:1788636611.490249:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788636611.490256:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:10397:x1875521225952640:12345-0@lo:104: 00010000:00010000:0.0:1788636611.490269:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.490538:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788636611.490546:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:10397:x1875521225952640:12345-0@lo:104: Request processed in 290us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.490554:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788636611.490609:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788636611.490617:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:10397:x1875521225952768:12345-0@lo:104: 00010000:00010000:0.0:1788636611.490626:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.490665:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788636611.490670:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:10397:x1875521225952768:12345-0@lo:104: Request processed in 56us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.490676:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788636611.490690:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788636611.490697:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:10397:x1875521225952896:12345-0@lo:104: 00010000:00010000:0.0:1788636611.490714:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf015990400/0x5b741ef42e837f5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.490751:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788636611.490757:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:10397:x1875521225952896:12345-0@lo:104: Request processed in 61us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.490763:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788636611.490782:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788636611.490789:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.490843:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636611.490849:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.490859:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636611.490868:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636611.490875:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636611.490914:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.490922:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636611.490941:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.490948:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015990800/0x5b741ef42e837fbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837fc3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.490962:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636611.490967:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.490973:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ece200 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636611.490976:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.490993:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636611.490999:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636611.491005:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636611.491019:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.491026:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636611.491043:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.491051:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015ece200/0x5b741ef42e837f68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f6f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.491062:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636611.491065:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015990400/0x5b741ef42e837f5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.491071:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990400 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636611.491074:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990400/0x5b741ef42e837f5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.491080:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015990400/0x5b741ef42e837f5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636611.491087:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990400/0x5b741ef42e837f5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636611.491099:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636611.491112:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015990400/0x5b741ef42e837f5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.491119:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636611.491126:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015990400/0x5b741ef42e837f5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.491133:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015990400/0x5b741ef42e837f5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e837f61 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.491149:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636611.491150:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636611.491152:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636611.491168:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225953280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636611.491213:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.491253:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636611.491259:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225953152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636611.491280:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.491315:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225953280 00000100:00100000:0.0:1788636611.491321:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225953280 00010000:00010000:2.0:1788636611.491442:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636611.491460:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225953152 00000100:00100000:2.0:1788636611.491464:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225953152 00010000:00010000:2.0:1788636611.491492:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e837f6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837f68 expref: 24 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636611.491519:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636611.491526:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225953152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636611.491540:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636611.491545:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e837f6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837f68 expref: 24 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.491556:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e837f6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837f68 expref: 24 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.491577:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636611.491626:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225953152:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.491633:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636611.491664:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225953024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636611.491697:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636611.491747:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225953152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636611.491770:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225953024 00000100:00100000:2.0:1788636611.491774:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225953024 00010000:00010000:2.0:1788636611.491797:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015990200/0x5b741ef42e837fc3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837fbc expref: 24 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636611.491834:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788636611.491841:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521225953024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636611.491850:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636611.491854:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015990200/0x5b741ef42e837fc3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837fbc expref: 24 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.491864:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015990200/0x5b741ef42e837fc3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837fbc expref: 24 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.491875:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636611.491901:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521225953024:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.491909:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788636611.491934:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225953024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636611.492305:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015990200/0x5b741ef42e837fc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837fbc expref: 23 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636611.492320:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875521225952640:0@lo:104: 00010000:00010000:3.0:1788636611.492463:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e837f6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837f68 expref: 22 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636611.492474:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875521225952768:0@lo:104: 00000100:00100000:3.0:1788636611.492499:0:10397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875521225952896:0@lo:104: 00010000:00010000:3.0:1788636611.492538:0:10397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.492636:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf015991200/0x5b741ef42e837f61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837f5a expref: 21 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636611.492710:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788636611.492719:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3649:x1875521225953280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636611.492729:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636611.492734:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf015991200/0x5b741ef42e837f61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e837f5a expref: 21 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.492749:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf015991200/0x5b741ef42e837f61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e837f5a expref: 21 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.492761:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015991200/0x5b741ef42e837f61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e837f5a expref: 21 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.492772:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636611.492854:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:3649:x1875521225953280:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.492862:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788636611.493069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636611.493131:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225953280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636611.494228:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636611.494278:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225952512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636611.494440:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207016064 00000100:00100000:2.0:1788636611.494449:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207016064 00010000:00010000:2.0:1788636611.494491:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e94 expref: 10 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636611.494518:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 39 00000100:00100000:2.0:1788636611.494527:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03653100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+10:2401:x1875521207016064:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636611.494544:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636611.494549:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e94 expref: 10 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.494561:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e94 expref: 10 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.494610:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e838201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e94 expref: 10 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.494627:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.494637:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.494655:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.494663:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.494669:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.494675:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.494682:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000030a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636611.494686:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.494696:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636611.495209:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788636611.495215:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf03a765800 from 4 10000000:01000000:0.0:1788636611.495220:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788636611.495265:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.495276:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.495286:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636611.495309:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225953408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.495398:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.495435:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaae900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636611.495453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225953408 00000100:00100000:0.0:1788636611.495458:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225953408 00000100:00100000:0.0:1788636611.495501:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788636611.495509:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225953408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636611.495538:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636611.495553:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8382d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8382cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.496234:0:10397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.496249:0:10397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.500243:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.500295:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8382c5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.500316:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636611.501465:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8382d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8382cc expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.501491:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8382d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8382cc expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.501501:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7400, rc 0) 00000100:00100000:0.0:1788636611.501626:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225953408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6116us (6226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.501637:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788636611.501745:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225953408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636611.501768:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.501779:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636611.501923:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225953536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.501967:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.502006:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaae900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636611.502028:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225953536 00000100:00100000:0.0:1788636611.502035:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225953536 00000100:00100000:0.0:1788636611.502088:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788636611.502099:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225953536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.502269:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225953536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.502277:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788636611.502311:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225953536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.502568:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225953664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.502627:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.502654:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaae900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636611.502822:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03653100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+9:2401:x1875521207016064:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 8275us (9735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.502835:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 39 00000100:00100000:1.0:1788636611.502988:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225953664 00000100:00100000:1.0:1788636611.502995:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225953664 00000100:00100000:1.0:1788636611.503032:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788636611.503040:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225953664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636611.503145:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225953664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636611.503153:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788636611.503623:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225953664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.505113:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10399:1875521225953792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636611.505217:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.505262:0:10399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636611.505503:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225953792 00000100:00100000:3.0:1788636611.505512:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225953792 00000100:00100000:3.0:1788636611.505656:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788636611.505668:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:10399:x1875521225953792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636611.506653:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:10399:x1875521225953792:12345-0@lo:502:llog_process_th.0 Request processed in 980us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636611.506668:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788636611.507227:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10399:1875521225953792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788636611.507276:0:10399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636611.507290:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636611.507293:0:10399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788636611.507303:0:10399:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf03a765800 00000020:00000080:3.0:1788636611.507306:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788636611.507902:0:10399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10399:1875521225953920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636611.507991:0:10399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636611.508024:0:10399:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef023979c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636611.508308:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225953920 00000100:00100000:0.0:1788636611.508318:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225953920 00000100:00100000:0.0:1788636611.508468:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788636611.508481:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:10399:x1875521225953920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636611.508683:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:10399:x1875521225953920:12345-0@lo:502:llog_process_th.0 Request processed in 204us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.508691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788636611.515351:0:10399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10399:1875521225953920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788636611.515416:0:10399:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636611.515428:0:10399:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636611.515431:0:10399:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788636611.515439:0:10399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788636611.515922:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788636611.515997:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636611.516012:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.516026:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636611.516046:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788636611.516050:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00f1a3000 from 4 10000000:01000000:1.0:1788636611.516053:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636611.516099:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.516108:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.516119:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636611.516149:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636611.516245:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636611.516292:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033ae780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636611.516906:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225954048 00000100:00100000:3.0:1788636611.516920:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225954048 00000100:00100000:3.0:1788636611.517028:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788636611.517040:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225954048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636611.517057:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636611.517076:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf000031000/0x5b741ef42e8382e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8382da expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.517108:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf000031000/0x5b741ef42e8382e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8382da expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.517120:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf000031000/0x5b741ef42e8382e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8382da expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636611.517130:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000031000, rc 0) 00000100:00100000:3.0:1788636611.517206:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225954048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636611.517213:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788636611.527546:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636611.527592:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.527620:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636611.532483:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.532611:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636611.532671:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef0219bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636611.533209:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225954176 00000100:00100000:3.0:1788636611.533223:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225954176 00000100:00100000:3.0:1788636611.533310:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788636611.533337:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225954176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636611.533556:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225954176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636611.533565:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788636611.533845:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.533914:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.533985:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636611.534017:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef0219bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636611.534097:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225954304 00000100:00100000:0.0:1788636611.534103:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225954304 00000100:00100000:0.0:1788636611.534379:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788636611.534392:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225954304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.534529:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225954304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.534546:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788636611.545803:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.547224:0:10403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10403:1875521225954432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636611.547451:0:10403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.547545:0:10403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636611.547645:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225954432 00000100:00100000:2.0:1788636611.547655:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225954432 00000100:00100000:2.0:1788636611.547787:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788636611.547801:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:10403:x1875521225954432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636611.548041:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:10403:x1875521225954432:12345-0@lo:502:llog_process_th.0 Request processed in 243us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.548051:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788636611.548690:0:10403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10403:1875521225954432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636611.548741:0:10403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636611.548756:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636611.548759:0:10403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788636611.548769:0:10403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf00f1a3000 00000020:00000080:0.0:1788636611.548772:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788636611.548903:0:10403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10403:1875521225954560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636611.548972:0:10403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.549010:0:10403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788636611.550607:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225954560 00000100:00100000:1.0:1788636611.550626:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225954560 00000100:00100000:1.0:1788636611.551004:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788636611.551018:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:10403:x1875521225954560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636611.551230:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:10403:x1875521225954560:12345-0@lo:502:llog_process_th.0 Request processed in 215us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636611.551240:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788636611.551942:0:10403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10403:1875521225954560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636611.551993:0:10403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636611.552005:0:10403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636611.552008:0:10403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788636611.552016:0:10403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788636611.561063:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788636611.561127:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636611.561147:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.561165:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636611.561178:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636611.561182:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00f150000 from 4 10000000:01000000:2.0:1788636611.561186:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636611.562624:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.562765:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.562783:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636611.562876:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.562988:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636611.563053:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef0219bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636611.565939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225954688 00000100:00100000:2.0:1788636611.565964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225954688 00000100:00100000:2.0:1788636611.566054:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788636611.566069:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225954688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636611.566106:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636611.566136:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab1e00/0x5b741ef42e8382ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8382e8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.566178:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab1e00/0x5b741ef42e8382ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8382e8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.566194:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab1e00/0x5b741ef42e8382ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8382e8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.566205:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1e00, rc 0) 00000100:00100000:2.0:1788636611.566323:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225954688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 258us (3335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.567505:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788636611.567659:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636611.567693:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.569899:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636611.570040:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.570141:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636611.570197:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef0219bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636611.570251:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225954816 00000100:00100000:2.0:1788636611.570261:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225954816 00000100:00100000:2.0:1788636611.570318:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788636611.570329:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225954816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.570992:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225954816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 663us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.571001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788636611.571063:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.571110:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.571158:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636611.571184:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef0219bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636611.571200:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225954944 00000100:00100000:2.0:1788636611.571205:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225954944 00000100:00100000:2.0:1788636611.571233:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788636611.571241:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225954944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.571322:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225954944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.571328:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788636611.572547:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225954944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636611.573997:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10406:1875521225955072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636611.574104:0:10406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636611.574157:0:10406:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636611.574203:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225955072 00000100:00100000:1.0:1788636611.574212:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225955072 00000100:00100000:1.0:1788636611.574269:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788636611.574281:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:10406:x1875521225955072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636611.574441:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:10406:x1875521225955072:12345-0@lo:502:llog_process_th.0 Request processed in 162us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636611.574455:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788636611.574505:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10406:1875521225955072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788636611.574535:0:10406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636611.574547:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636611.574551:0:10406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788636611.574559:0:10406:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf00f150000 00000020:00000080:3.0:1788636611.574562:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788636611.574675:0:10406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10406:1875521225955200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636611.574720:0:10406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636611.574734:0:10406:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636611.579691:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225955200 00000100:00100000:2.0:1788636611.579959:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225955200 00000100:00100000:2.0:1788636611.580028:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788636611.580040:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:10406:x1875521225955200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636611.580266:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:10406:x1875521225955200:12345-0@lo:502:llog_process_th.0 Request processed in 226us (5544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.580275:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788636611.583047:0:10406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10406:1875521225955200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788636611.583105:0:10406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636611.583115:0:10406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636611.583118:0:10406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788636611.583124:0:10406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788636611.588312:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788636611.588380:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636611.588397:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.588415:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636611.588429:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788636611.588432:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00324c000 from 4 10000000:01000000:1.0:1788636611.588437:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636611.588498:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.588507:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.588521:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636611.588559:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225955328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636611.588682:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636611.588912:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636611.590453:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225955328 00000100:00100000:0.0:1788636611.590471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225955328 00000100:00100000:0.0:1788636611.590545:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788636611.590558:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225955328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636611.590580:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636611.590619:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6000/0x5b741ef42e8382fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8382f6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.590679:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6000/0x5b741ef42e8382fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8382f6 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.591442:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6000/0x5b741ef42e8382fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8382f6 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.591461:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6000, rc 0) 00000100:00100000:0.0:1788636611.591565:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225955328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1008us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.591575:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788636611.591687:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225955328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636611.591724:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636611.591736:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636611.591853:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225955456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.591895:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.591927:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad300 going to sleep for 11 seconds 00000100:00100000:0.0:1788636611.591944:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225955456 00000100:00100000:0.0:1788636611.591949:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225955456 00000100:00100000:0.0:1788636611.591981:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788636611.591990:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225955456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.592115:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225955456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.592135:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788636611.592164:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225955456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.592195:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225955584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.592239:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636611.592252:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad300 going to sleep for 11 seconds 00000100:00100000:0.0:1788636611.592263:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225955584 00000100:00100000:0.0:1788636611.592267:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225955584 00000100:00100000:0.0:1788636611.592283:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788636611.592289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225955584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636611.592380:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225955584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636611.592386:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788636611.592421:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225955584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.595122:0:10409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10409:1875521225955712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636611.595228:0:10409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636611.595284:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225955712 00000100:00100000:2.0:1788636611.595292:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225955712 00000100:00100000:2.0:1788636611.595964:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788636611.595979:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:10409:x1875521225955712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636611.596142:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:10409:x1875521225955712:12345-0@lo:502:llog_process_th.0 Request processed in 167us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.596151:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788636611.596225:0:10409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef0219bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636611.596254:0:10409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10409:1875521225955712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636611.596290:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636611.596303:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636611.596305:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788636611.596313:0:10409:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf00324c000 00000020:00000080:2.0:1788636611.596315:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788636611.596835:0:10409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10409:1875521225955840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636611.596888:0:10409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636611.596918:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225955840 00000100:00100000:2.0:1788636611.596924:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225955840 00000100:00100000:2.0:1788636611.596956:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788636611.596964:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:10409:x1875521225955840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636611.597037:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:10409:x1875521225955840:12345-0@lo:502:llog_process_th.0 Request processed in 73us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.597044:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788636611.597077:0:10409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00823ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636611.597093:0:10409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:10409:1875521225955840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636611.597111:0:10409:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636611.597122:0:10409:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636611.597124:0:10409:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788636611.597128:0:10409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788636611.597199:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788636611.597235:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636611.597247:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636611.597260:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636611.630955:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636611.631177:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207016192 00000100:00100000:1.0:1788636611.631194:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207016192 00000100:00100000:1.0:1788636611.631275:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 272 00000100:00100000:1.0:1788636611.631288:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+9:6174:x1875521207016192:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636611.631312:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636611.631352:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e838304 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38eda expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.631401:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e838304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38eda expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.631418:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e838304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38eda expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636611.631431:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37800, rc 0) 00000100:00100000:1.0:1788636611.631513:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:6174:x1875521207016192:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 Request processed in 227us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636611.631521:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 272 00000100:00100000:2.0:1788636611.649217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636611.649261:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207016320 00000100:00100000:2.0:1788636611.649273:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207016320 00000100:00100000:1.0:1788636611.649481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 273 00000100:00100000:1.0:1788636611.649498:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:6174:x1875521207016320:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636611.649752:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:6174:x1875521207016320:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 Request processed in 258us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636611.649761:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 273 00000100:00100000:3.0:1788636611.652969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636611.653826:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207016448 00000100:00100000:2.0:1788636611.653841:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207016448 00000100:00100000:2.0:1788636611.653901:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 274 00000100:00100000:2.0:1788636611.653913:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:6174:x1875521207016448:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636611.654113:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:6174:x1875521207016448:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 Request processed in 201us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.654122:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 274 00000100:00100000:0.0:1788636611.672794:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636611.677041:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207016576 00000100:00100000:2.0:1788636611.677064:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207016576 00000100:00100000:2.0:1788636611.677142:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 275 00000100:00100000:2.0:1788636611.677155:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:6686:x1875521207016576:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788636611.677345:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:6686:x1875521207016576:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 193us (4572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636611.677353:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 275 00000100:00100000:1.0:1788636611.693568:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636611.693654:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207016704 00000100:00100000:1.0:1788636611.693671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207016704 00000100:00100000:1.0:1788636611.693741:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 276 00000100:00100000:1.0:1788636611.693753:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:6686:x1875521207016704:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788636611.693975:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:6686:x1875521207016704:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 223us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636611.693985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 276 00010000:00010000:2.0:1788636611.989542:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636612.255125:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225955968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636612.255239:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636612.255494:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225955968 00000100:00100000:2.0:1788636612.255581:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225955968 00000100:00100000:2.0:1788636612.255661:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788636612.255674:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225955968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636612.255723:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636612.255785:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225955968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636612.255795:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788636612.256704:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636612.256768:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fc71f80 x1875521225955968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636612.256939:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225956224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636612.257006:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636612.257058:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225956224 00000100:00100000:3.0:1788636612.257064:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225956224 00000100:00100000:3.0:1788636612.257111:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788636612.257135:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225956224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788636612.257175:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788636612.257224:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225956224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636612.257231:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788636612.257271:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225956224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636612.257317:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225956096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636612.258908:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225955968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636612.263956:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636612.264929:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225956096 00000100:00100000:2.0:1788636612.264948:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225956096 00000100:00100000:2.0:1788636612.265079:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636612.265093:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225956096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636612.265131:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636612.265233:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225956096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 143us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636612.265242:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788636612.265321:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d7480 x1875521225956096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636612.265352:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225956096:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788636612.265550:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636612.744472:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636612.744526:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636612.744571:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636612.744594:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636612.744627:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636612.744666:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207017344 00000100:00100000:3.0:1788636612.748175:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207017088 00000100:00100000:3.0:1788636612.748203:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207017088 00000100:00100000:3.0:1788636612.748326:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207016960 00000100:00100000:3.0:1788636612.748331:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207016960 00000100:00100000:3.0:1788636612.748370:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 78 00000100:00100000:3.0:1788636612.748387:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207017088:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636612.748543:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207017088:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 161us (4015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636612.748554:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 78 00000100:00100000:3.0:1788636612.748590:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 79 00000100:00100000:3.0:1788636612.748597:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207016960:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636612.748627:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207016960:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 30us (4031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636612.748634:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 79 00000100:00080000:3.0:1788636612.748660:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636612.748666:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636612.748746:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207017216 00000100:00100000:3.0:1788636612.748753:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207017216 00000100:00100000:3.0:1788636612.748845:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:3.0:1788636612.748854:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207017216:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636612.748885:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207017216:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 33us (4257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636612.748893:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00080000:3.0:1788636612.749105:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636612.749238:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207016832 00000100:00100000:1.0:1788636612.749247:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207016832 00000100:00100000:1.0:1788636612.749302:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 277 00000100:00100000:1.0:1788636612.749311:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207016832:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636612.749347:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207016832:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 39us (4895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636612.749355:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 277 00000100:00100000:2.0:1788636612.750061:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207017344 00000100:00100000:2.0:1788636612.750142:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:2.0:1788636612.750153:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207017344:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636612.750215:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207017344:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 65us (5643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636612.750222:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00080000:1.0:1788636612.750691:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788636613.014462:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636613.270673:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225956352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636613.270783:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636613.270910:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225956352 00000100:00100000:1.0:1788636613.270923:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225956352 00000100:00100000:1.0:1788636613.270991:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788636613.271003:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225956352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636613.271058:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788636613.273429:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225956352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2412us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636613.273449:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788636613.273594:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225956352:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788636614.038309:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636614.805354:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225956864:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.805463:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636614.805563:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225957376:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.805599:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636614.805629:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225957888:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.805666:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636614.805698:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788636614.805704:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225956736:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.805732:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636614.806225:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225957248:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.806261:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636614.806282:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225957760:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.806303:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636614.806339:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225956864 00000100:00100000:3.0:1788636614.806350:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225956864 00000100:00100000:3.0:1788636614.806971:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225957248 00000100:00100000:3.0:1788636614.806979:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225957248 00000100:00100000:2.0:1788636614.807094:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225956480:0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.807154:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636614.807188:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225956992:0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.807247:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636614.807273:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225957504:0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.807296:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636614.807315:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225958016:0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.807335:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636614.807359:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788636614.807366:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225956608:0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.807389:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636614.807399:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225957120:0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.807447:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636614.807462:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225957632:0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.807485:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636614.807531:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225957376 00000100:00100000:2.0:1788636614.807537:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225957376 00000100:00100000:3.0:1788636614.807593:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225957760 00000100:00100000:3.0:1788636614.807597:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225957760 00000100:00100000:0.0:1788636614.808337:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225958144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636614.808387:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636614.808447:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225958144 00000100:00100000:0.0:1788636614.808453:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225958144 00000100:00080000:1.0:1788636614.811372:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636614.811387:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636614.811392:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636614.811761:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225956480 00000100:00100000:1.0:1788636614.811776:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225956480 00000100:00100000:1.0:1788636614.811882:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788636614.811894:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225956480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636614.812046:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225956480:12345-0@lo:400:kworker.0 Request processed in 154us (4891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636614.812070:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788636614.812122:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225956736 00000100:00100000:1.0:1788636614.812127:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225956736 00000100:00100000:1.0:1788636614.812157:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225956992 00000100:00100000:1.0:1788636614.812161:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225956992 00000100:00100000:1.0:1788636614.812176:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788636614.812182:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225956736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636614.812238:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225956736:12345-0@lo:400:kworker.0 Request processed in 55us (6504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636614.812245:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788636614.812257:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788636614.812262:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225956992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636614.812293:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225956992:12345-0@lo:400:kworker.0 Request processed in 30us (5045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636614.812299:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788636614.814955:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225957888 00000100:00100000:2.0:1788636614.814973:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225957888 00000100:00100000:2.0:1788636614.815006:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225957504 00000100:00100000:2.0:1788636614.815010:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225957504 00000100:00100000:2.0:1788636614.815036:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225958016 00000100:00100000:2.0:1788636614.815040:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225958016 00000100:00100000:2.0:1788636614.815072:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788636614.815084:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225957376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.815203:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225957376:12345-0@lo:400:kworker.0 Request processed in 121us (9602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636614.815212:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788636614.815234:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788636614.815241:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225957888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.815275:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225957888:12345-0@lo:400:kworker.0 Request processed in 35us (9608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636614.815282:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788636614.815294:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636614.815301:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225957504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.815334:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225957504:12345-0@lo:400:kworker.0 Request processed in 34us (8036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636614.815340:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636614.815351:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788636614.815378:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521225958016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.815412:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521225958016:12345-0@lo:400:kworker.0 Request processed in 35us (8076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636614.815418:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788636614.816422:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225956608 00000100:00100000:2.0:1788636614.816433:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225956608 00000100:00100000:2.0:1788636614.816482:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225957120 00000100:00100000:2.0:1788636614.816486:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225957120 00000100:00100000:2.0:1788636614.816516:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225957632 00000100:00100000:2.0:1788636614.816519:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225957632 00000100:00100000:2.0:1788636614.816539:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788636614.816549:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225956864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.816636:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225956864:12345-0@lo:400:kworker.0 Request processed in 88us (11174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636614.816644:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788636614.816663:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788636614.816672:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225957248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.816707:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225957248:12345-0@lo:400:kworker.0 Request processed in 37us (10445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636614.816713:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788636614.816727:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788636614.816733:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225956608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.817503:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225956608:12345-0@lo:400:kworker.0 Request processed in 756us (10099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636614.817513:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788636614.817534:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788636614.817542:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225957120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.817663:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225957120:12345-0@lo:400:kworker.0 Request processed in 122us (10215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636614.817670:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788636614.817685:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788636614.817691:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225957632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.817721:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225957632:12345-0@lo:400:kworker.0 Request processed in 31us (10235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636614.817727:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788636614.818322:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225956736:0@lo:400:kworker.0 00010000:00080000:2.0:1788636614.818346:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d4e00 x1875521225957248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636614.818357:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225957248:0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.818374:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225956864:0@lo:400:kworker.0 00010000:00080000:2.0:1788636614.818385:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d5500 x1875521225957376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636614.818395:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225957376:0@lo:400:kworker.0 00010000:00080000:2.0:1788636614.818408:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d5c00 x1875521225957888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636614.818416:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225957888:0@lo:400:kworker.0 00000100:00100000:2.0:1788636614.818443:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636614.818463:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225958272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636614.818533:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636614.818690:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225958272 00000100:00100000:2.0:1788636614.818697:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225958272 00000100:00100000:2.0:1788636614.818739:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636614.819955:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225958272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636614.820047:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636614.820409:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225958272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 474us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636614.820420:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788636614.820510:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc0380 x1875521225958272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636614.820537:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225958272:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788636614.820768:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636614.820779:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636614.820782:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636614.821262:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788636614.821275:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225957760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.821355:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225957760:12345-0@lo:400:kworker.0 Request processed in 84us (15051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636614.821363:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788636614.821402:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d6300 x1875521225957760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636614.821519:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225957760:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.824836:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225956608:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.824925:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225957120:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.824942:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225957632:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.824956:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225956480:0@lo:400:kworker.0 00000100:00100000:3.0:1788636614.824971:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225956992:0@lo:400:kworker.0 00010000:00080000:3.0:1788636614.824989:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d5880 x1875521225957504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636614.825003:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225957504:0@lo:400:kworker.0 00010000:00080000:3.0:1788636614.825017:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d6a00 x1875521225958016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636614.825288:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225958016:0@lo:400:kworker.0 00000100:00100000:0.0:1788636614.825978:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788636614.825997:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225958144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636614.826047:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636614.826173:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225958144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (17783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636614.826181:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788636614.828919:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03654e00 x1875521225958144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636614.828959:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225958144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788636615.061767:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636616.086508:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636617.110357:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636617.365179:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636617.365211:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225958400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636617.365306:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636617.365499:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225958400 00000100:00100000:0.0:1788636617.365510:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225958400 00000100:00100000:0.0:1788636617.365605:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788636617.365621:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225958400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636617.365666:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636617.365724:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225958400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636617.365733:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788636617.365947:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225958528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636617.365983:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636617.366168:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636617.366177:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225958656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636617.366209:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636617.366237:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225958656 00000100:00100000:0.0:1788636617.366242:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225958656 00000100:00100000:0.0:1788636617.366271:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788636617.366278:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225958656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636617.366308:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636617.366358:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225958656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636617.366364:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788636617.366427:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225958656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636617.366453:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225958528 00000100:00100000:0.0:1788636617.366456:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225958528 00000100:00100000:0.0:1788636617.366475:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788636617.366481:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225958528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788636617.366492:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636617.366519:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225958528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636617.366541:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788636617.366684:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03451180 x1875521225958528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636617.366700:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225958528:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788636617.366775:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636617.366831:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc0380 x1875521225958400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636617.366857:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225958400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636617.865708:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636617.865760:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636617.865798:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636617.865884:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636617.865911:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636617.865944:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207017984 00000100:00100000:0.0:1788636617.865955:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207017984 00000100:00100000:0.0:1788636617.866012:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207017856 00000100:00100000:0.0:1788636617.866015:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207017856 00000100:00100000:0.0:1788636617.866039:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:0.0:1788636617.866049:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207017984:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636617.866126:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207017984:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636617.866134:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:0.0:1788636617.866151:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 34 00000100:00100000:0.0:1788636617.866158:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207017856:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636617.866181:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207017856:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 23us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636617.866187:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 34 00000100:00100000:0.0:1788636617.866389:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207017728 00000100:00100000:0.0:1788636617.866394:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207017728 00000100:00100000:1.0:1788636617.866709:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207017472 00000100:00100000:1.0:1788636617.866715:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207017472 00000100:00100000:1.0:1788636617.866754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 279 00000100:00100000:1.0:1788636617.866762:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:2401:x1875521207017472:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636617.866798:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:2401:x1875521207017472:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 37us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636617.866833:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 279 00000100:00100000:2.0:1788636617.868369:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207017600 00000100:00100000:2.0:1788636617.868388:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207017600 00000100:00100000:2.0:1788636617.868484:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 86 00000100:00100000:2.0:1788636617.868496:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207017600:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636617.868582:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207017600:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 87us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636617.868590:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 86 00000100:00080000:2.0:1788636617.868716:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636617.868721:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636617.868724:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636617.868938:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 87 00000100:00100000:0.0:1788636617.868946:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207017728:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636617.868985:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207017728:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 41us (3224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636617.868992:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 87 00000100:00080000:2.0:1788636617.869245:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788636618.134841:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636618.388962:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636618.388987:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225958784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636618.389070:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636618.389156:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225958784 00000100:00100000:1.0:1788636618.389165:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225958784 00000100:00100000:1.0:1788636618.389216:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788636618.389226:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225958784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636618.389263:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788636618.389309:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225958784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636618.389317:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788636618.389364:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225958784:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788636619.158097:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788636619.884053:0:10698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788636619.925033:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225958912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636619.925118:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.925170:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225959424:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.925199:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.925217:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225959936:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.925239:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.925256:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225960448:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.925274:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.925297:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788636619.925303:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225959296:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.925327:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.925360:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225959808:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.925430:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.925978:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225960320:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.926007:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.926044:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225959040:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.926078:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.926103:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225959552:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.926126:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.926144:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225960064:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.926167:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636619.926167:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225959424 00000100:00100000:0.0:1788636619.926178:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225959424 00000100:00100000:3.0:1788636619.926187:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225960576:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.926210:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636619.926227:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225959808 00000100:00100000:0.0:1788636619.926232:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225959808 00000100:00100000:3.0:1788636619.926233:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788636619.926241:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225959168:0@lo:400:kworker.0 00000100:00100000:0.0:1788636619.926266:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225960320 00000100:00100000:3.0:1788636619.926269:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636619.926271:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225960320 00000100:00100000:0.0:1788636619.926291:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225959168 00000100:00100000:3.0:1788636619.926293:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225959680:0@lo:400:kworker.0 00000100:00100000:0.0:1788636619.926295:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225959168 00000100:00100000:0.0:1788636619.926321:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788636619.926325:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636619.926348:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225959424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.926355:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225960192:0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.926379:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.926390:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225960704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636619.928049:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636619.928160:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225958912 00000100:00100000:1.0:1788636619.928167:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225960704 00000100:00100000:3.0:1788636619.928171:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225958912 00000100:00100000:1.0:1788636619.928171:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225960704 00000100:00100000:3.0:1788636619.928222:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788636619.928233:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225958912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788636619.928271:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636619.928349:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225958912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (3230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636619.928357:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788636619.930301:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225959424:12345-0@lo:400:kworker.0 Request processed in 3957us (5090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636619.930314:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788636619.930360:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225959680 00000100:00100000:0.0:1788636619.930368:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225959680 00000100:00100000:0.0:1788636619.930402:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225960192 00000100:00100000:0.0:1788636619.930405:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225960192 00000100:00100000:0.0:1788636619.930423:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788636619.930432:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225959808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636619.930513:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225959808:12345-0@lo:400:kworker.0 Request processed in 83us (5081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636619.930519:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788636619.930544:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788636619.930552:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225960320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636619.930584:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225960320:12345-0@lo:400:kworker.0 Request processed in 32us (4576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636619.930590:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788636619.930600:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788636619.930606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225959168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636619.930647:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225959168:12345-0@lo:400:kworker.0 Request processed in 41us (4379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636619.930653:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788636619.930667:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788636619.930672:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225959680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636619.930698:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225959680:12345-0@lo:400:kworker.0 Request processed in 27us (4375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636619.930704:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788636619.930715:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788636619.930721:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225960192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636619.931177:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225960192:12345-0@lo:400:kworker.0 Request processed in 29us (4370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636619.931185:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788636619.931211:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636619.931217:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636619.931219:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636619.931316:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03450700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225959168:0@lo:400:kworker.0 00000100:00100000:2.0:1788636619.931343:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225959680:0@lo:400:kworker.0 00000100:00100000:2.0:1788636619.931357:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225960192:0@lo:400:kworker.0 00000100:00100000:1.0:1788636619.931484:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788636619.931495:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225960704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636619.931513:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636619.931557:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225960704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (3521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636619.931564:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788636619.931715:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657100 x1875521225960704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636619.931733:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225960704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636619.931877:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225959296 00000100:00100000:2.0:1788636619.931883:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225959296 00000100:00100000:2.0:1788636619.931962:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225959552 00000100:00100000:2.0:1788636619.931966:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225959552 00000100:00100000:1.0:1788636619.932009:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636619.932017:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225959296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636619.932058:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225959296:12345-0@lo:400:kworker.0 Request processed in 43us (6730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636619.932075:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636619.932090:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788636619.932097:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225959552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636619.932159:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225959552:12345-0@lo:400:kworker.0 Request processed in 63us (6031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636619.932165:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788636619.932201:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225959552:0@lo:400:kworker.0 00000100:00100000:2.0:1788636619.932501:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225959936 00000100:00100000:2.0:1788636619.932507:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225959936 00000100:00100000:2.0:1788636619.932594:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225960448 00000100:00100000:2.0:1788636619.932598:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225960448 00000100:00100000:2.0:1788636619.932613:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225960064 00000100:00100000:2.0:1788636619.932617:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225960064 00000100:00080000:1.0:1788636619.932646:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636619.932737:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225960576 00000100:00100000:2.0:1788636619.932741:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225960576 00000100:00100000:2.0:1788636619.932758:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636619.932767:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225959936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636619.932855:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225959936:12345-0@lo:400:kworker.0 Request processed in 88us (7612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636619.932863:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636619.932888:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636619.932897:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3649:x1875521225960448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636619.932929:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3649:x1875521225960448:12345-0@lo:400:kworker.0 Request processed in 35us (7654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636619.932936:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636619.932947:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788636619.932953:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225960064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636619.932987:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225960064:12345-0@lo:400:kworker.0 Request processed in 34us (6820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636619.932992:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788636619.933003:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788636619.933008:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225960576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636619.933032:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225960576:12345-0@lo:400:kworker.0 Request processed in 25us (6822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636619.933036:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788636619.933586:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225959040 00000100:00100000:3.0:1788636619.933968:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225959040 00000100:00100000:3.0:1788636619.934013:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788636619.934020:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225959040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636619.934065:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225959040:12345-0@lo:400:kworker.0 Request processed in 46us (7986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636619.934071:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788636619.934131:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225959296:0@lo:400:kworker.0 00010000:00080000:3.0:1788636619.934148:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03453800 x1875521225959808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636619.934157:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225959808:0@lo:400:kworker.0 00010000:00080000:3.0:1788636619.934179:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02712680 x1875521225960320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636619.934187:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225960320:0@lo:400:kworker.0 00010000:00080000:3.0:1788636619.934199:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03450000 x1875521225958912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636619.934214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225958912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636619.934226:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225959424:0@lo:400:kworker.0 00010000:00080000:3.0:1788636619.934237:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03450a80 x1875521225959936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636619.934244:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225959936:0@lo:400:kworker.0 00010000:00080000:3.0:1788636619.934252:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02711c00 x1875521225960448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636619.934260:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225960448:0@lo:400:kworker.0 00000100:00100000:1.0:1788636619.934668:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225959040:0@lo:400:kworker.0 00010000:00080000:1.0:1788636619.934684:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03450e00 x1875521225960064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636619.934692:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225960064:0@lo:400:kworker.0 00010000:00080000:1.0:1788636619.934701:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02711180 x1875521225960576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636619.934708:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225960576:0@lo:400:kworker.0 00010000:00010000:1.0:1788636620.189116:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636621.205593:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636622.230861:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636622.486737:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225960832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636622.486842:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636622.490983:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225960960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636622.491127:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636622.491364:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225960832 00000100:00100000:2.0:1788636622.491375:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225960832 00000100:00100000:2.0:1788636622.491420:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225960960 00000100:00100000:2.0:1788636622.491422:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225960960 00000100:00100000:2.0:1788636622.491436:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788636622.491444:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225960832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636622.491478:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636622.491525:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225960832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (4683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636622.491543:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788636622.491561:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788636622.491568:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225960960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636622.491578:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636622.491604:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225960960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636622.491609:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788636622.491625:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636622.491660:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc0380 x1875521225960832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636622.491680:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225960832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636622.496968:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225961088:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636622.497101:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636622.497170:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225961088 00000100:00100000:1.0:1788636622.497180:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225961088 00000100:00100000:1.0:1788636622.497238:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788636622.497248:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225961088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788636622.497315:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788636622.497529:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225961088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 281us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636622.497538:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788636622.497597:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225961088:0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1788636622.498141:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc1880 x1875521225960960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636622.498178:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225960960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636622.980013:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636622.980069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636622.980102:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636622.980136:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207018112 00000100:00100000:3.0:1788636622.980156:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207018112 00000100:00100000:3.0:1788636622.980218:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 281 00000100:00100000:3.0:1788636622.980231:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:2399:x1875521207018112:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636622.980610:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:2399:x1875521207018112:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 380us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636622.980620:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 281 00000100:00100000:3.0:1788636622.980670:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207018368 00000100:00100000:3.0:1788636622.980676:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207018368 00000100:00100000:3.0:1788636622.980718:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207018240 00000100:00100000:3.0:1788636622.980721:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207018240 00000100:00100000:3.0:1788636622.980738:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 94 00000100:00100000:3.0:1788636622.980746:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207018368:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636622.980775:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207018368:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 31us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636622.980782:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 94 00000100:00100000:3.0:1788636622.980792:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 95 00000100:00100000:3.0:1788636622.980797:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2399:x1875521207018240:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636622.980844:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2399:x1875521207018240:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 47us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636622.980851:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 95 00000100:00080000:3.0:1788636622.980989:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636622.980994:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636622.989769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636622.989829:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636622.992475:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207018496 00000100:00100000:0.0:1788636622.992497:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207018496 00000100:00100000:0.0:1788636622.992623:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207018624 00000100:00100000:0.0:1788636622.992627:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207018624 00000100:00100000:0.0:1788636622.992662:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:0.0:1788636622.992673:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2397:x1875521207018496:12345-192.168.202.26@tcp:9:kworker.0 00000020:00000080:0.0:1788636622.992716:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838216 00000100:00080000:0.0:1788636622.992725:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9cef034cb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788636622.992771:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788636622.992972:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02712680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+2:2397:x1875521207018496:12345-192.168.202.26@tcp:9:kworker.0 Request processed in 300us (3211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636622.992980:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:0.0:1788636622.992997:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:0.0:1788636622.993003:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2397:x1875521207018624:12345-192.168.202.26@tcp:9:kworker.0 00000020:00000080:0.0:1788636622.993016:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e83821d 00000100:00080000:0.0:1788636622.993022:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9cef033a3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788636622.993042:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788636622.993114:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+2:2397:x1875521207018624:12345-192.168.202.26@tcp:9:kworker.0 Request processed in 111us (3284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636622.993121:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 19 00010000:00010000:0.0:1788636622.993204:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636622.993209:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788636622.993525:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636622.993531:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788636623.253630:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636623.508946:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636623.508969:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225961216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636623.509053:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636623.509131:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225961216 00000100:00100000:1.0:1788636623.509140:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225961216 00000100:00100000:1.0:1788636623.509197:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788636623.509208:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225961216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636623.509262:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788636623.509347:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225961216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636623.509355:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788636623.509426:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225961216:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788636624.280616:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636625.045261:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636625.045296:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225961472:0@lo:400:kworker.0 00000100:00100000:0.0:1788636625.045376:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225961600:0@lo:400:kworker.0 00000100:00100000:1.0:1788636625.045481:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225961856:0@lo:400:kworker.0 00000100:00100000:0.0:1788636625.048285:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636625.048362:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636625.048384:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225962112:0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.048407:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225961344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636625.048447:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636625.048469:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225962624:0@lo:400:kworker.0 00000100:00100000:0.0:1788636625.048491:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636625.048525:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788636625.048533:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225961728:0@lo:400:kworker.0 00000100:00100000:0.0:1788636625.048560:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636625.048581:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521225962240:0@lo:400:kworker.0 00000100:00100000:0.0:1788636625.048602:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636625.048613:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521225962752:0@lo:400:kworker.0 00000100:00100000:0.0:1788636625.048633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636625.048698:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225961728 00000100:00100000:0.0:1788636625.048706:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225961728 00000100:00100000:0.0:1788636625.048752:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788636625.048762:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225961728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636625.048835:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225961728:12345-0@lo:400:kworker.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636625.048843:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788636625.048871:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225963136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636625.048911:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636625.048943:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225961984:0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.048969:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636625.048989:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225962496:0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.049015:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636625.049034:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225963008:0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.049057:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636625.049111:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225961600 00000100:00100000:3.0:1788636625.049117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225961600 00000100:00100000:3.0:1788636625.049141:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225962112 00000100:00100000:3.0:1788636625.049143:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225962112 00000100:00100000:3.0:1788636625.049165:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225962624 00000100:00100000:3.0:1788636625.049168:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225962624 00000100:00100000:3.0:1788636625.049195:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225962240 00000100:00100000:3.0:1788636625.049198:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225962240 00000100:00100000:3.0:1788636625.049209:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225962752 00000100:00100000:3.0:1788636625.049211:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225962752 00000100:00100000:3.0:1788636625.049224:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788636625.049230:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225961600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.049264:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225961600:12345-0@lo:400:kworker.0 Request processed in 33us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636625.049270:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788636625.049284:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788636625.049290:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225962112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.049315:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225962112:12345-0@lo:400:kworker.0 Request processed in 25us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636625.049329:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788636625.049342:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788636625.049349:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225962624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.049378:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225962624:12345-0@lo:400:kworker.0 Request processed in 30us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636625.049384:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788636625.049395:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788636625.049400:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521225962240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.049425:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521225962240:12345-0@lo:400:kworker.0 Request processed in 25us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636625.049431:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788636625.049442:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788636625.049448:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521225962752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.049475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521225962752:12345-0@lo:400:kworker.0 Request processed in 28us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636625.050393:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788636625.050564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225961472 00000100:00100000:3.0:1788636625.050573:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225961472 00000100:00100000:3.0:1788636625.050615:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788636625.050624:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225961472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.050830:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225961472:12345-0@lo:400:kworker.0 Request processed in 206us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636625.050838:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788636625.050849:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636625.050907:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225961728:0@lo:400:kworker.0 00010000:00080000:0.0:1788636625.050922:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03654a80 x1875521225962240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636625.050932:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521225962240:0@lo:400:kworker.0 00010000:00080000:0.0:1788636625.050944:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf00f1eed80 x1875521225962752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636625.050953:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521225962752:0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.050956:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225961344 00000100:00100000:3.0:1788636625.050963:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225961344 00000100:00100000:0.0:1788636625.050967:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225961600:0@lo:400:kworker.0 00000100:00100000:0.0:1788636625.050996:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225962112:0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.050999:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225963136 00000100:00100000:3.0:1788636625.051004:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225963136 00000100:00100000:0.0:1788636625.051011:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225962624:0@lo:400:kworker.0 00000100:00100000:3.0:1788636625.051026:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788636625.051036:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225961344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788636625.051061:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636625.051061:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225961984 00000100:00100000:0.0:1788636625.051067:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225961984 00000100:00100000:0.0:1788636625.051094:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788636625.051102:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225961984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636625.052495:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636625.052536:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225962368:0@lo:400:kworker.0 00000100:00100000:1.0:1788636625.055559:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636625.055639:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225962880:0@lo:400:kworker.0 00000100:00100000:1.0:1788636625.055705:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636625.055763:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225962496 00000100:00100000:1.0:1788636625.055773:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225962496 00000100:00100000:1.0:1788636625.055851:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225963008 00000100:00100000:1.0:1788636625.055855:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225963008 00000100:00100000:1.0:1788636625.055870:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225962368 00000100:00100000:1.0:1788636625.055873:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225962368 00000100:00100000:1.0:1788636625.055886:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225962880 00000100:00100000:1.0:1788636625.055889:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225962880 00000100:00100000:1.0:1788636625.055903:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788636625.055913:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225962496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636625.055976:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225962496:12345-0@lo:400:kworker.0 Request processed in 64us (6960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636625.055984:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788636625.056003:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788636625.056009:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521225963008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636625.056037:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521225963008:12345-0@lo:400:kworker.0 Request processed in 28us (6980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636625.056043:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788636625.056053:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788636625.056059:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225962368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636625.056092:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225962368:12345-0@lo:400:kworker.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636625.056097:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788636625.056106:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788636625.056113:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875521225962880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636625.056299:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875521225962880:12345-0@lo:400:kworker.0 Request processed in 186us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636625.056313:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788636625.056362:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03655180 x1875521225962368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636625.056378:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225962368:0@lo:400:kworker.0 00010000:00080000:1.0:1788636625.056388:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf00f179c00 x1875521225962880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636625.056401:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225962880:0@lo:400:kworker.0 00000100:00100000:1.0:1788636625.056427:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225961856 00000100:00100000:1.0:1788636625.056431:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225961856 00000100:00100000:1.0:1788636625.056460:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788636625.056467:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225961856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636625.056504:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225961856:12345-0@lo:400:kworker.0 Request processed in 37us (4015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636625.056510:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788636625.056538:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225961856:0@lo:400:kworker.0 00000100:00100000:0.0:1788636625.060400:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225961984:12345-0@lo:400:kworker.0 Request processed in 9280us (11411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636625.060417:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788636625.060488:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636625.060494:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636625.060497:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636625.060501:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636625.060565:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225961984:0@lo:400:kworker.0 00010000:00080000:0.0:1788636625.060584:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657800 x1875521225962496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636625.060595:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225962496:0@lo:400:kworker.0 00010000:00080000:0.0:1788636625.060607:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef023fc380 x1875521225963008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636625.060617:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225963008:0@lo:400:kworker.0 00000100:00100000:0.0:1788636625.060628:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225961472:0@lo:400:kworker.0 00000100:00100000:2.0:1788636625.063896:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225961344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12850us (14973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636625.063914:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788636625.063956:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788636625.063972:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225963136:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788636625.064071:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03518a80 x1875521225961344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636625.064107:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225961344:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636625.064248:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636625.064355:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225963136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 389us (13508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636625.064362:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788636625.064435:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef019b0a80 x1875521225963136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636625.064449:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225963136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788636625.303841:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788636625.536246:0:10942:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing yml_node 00010000:00010000:1.0:1788636626.327096:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636627.353493:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636627.610858:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225963264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636627.610946:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636627.610984:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225963520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636627.611017:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636627.611053:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636627.611059:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225963520 00000100:00100000:2.0:1788636627.611061:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225963392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636627.611068:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225963520 00000100:00100000:2.0:1788636627.611083:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636627.611130:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788636627.611141:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225963520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636627.611178:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636627.611236:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225963520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636627.611244:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788636627.611465:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225963520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636627.611537:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225963264 00000100:00100000:3.0:1788636627.611543:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225963264 00000100:00100000:3.0:1788636627.611579:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225963392 00000100:00100000:3.0:1788636627.611582:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225963392 00000100:00100000:3.0:1788636627.611599:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788636627.611606:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225963264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636627.611627:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636627.611670:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225963264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636627.611676:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788636627.611690:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636627.611696:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225963392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636627.611706:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788636627.615295:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636627.615420:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0351bb80 x1875521225963264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636627.615476:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225963264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636627.623990:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225963392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 12276us (12887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636627.624011:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788636627.628741:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc0380 x1875521225963392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636643 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636627.628776:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225963392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636628.099940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636628.099993:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636628.100042:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636628.101791:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207019008 00000100:00100000:1.0:1788636628.101845:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207019008 00000100:00100000:1.0:1788636628.101932:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207018880 00000100:00100000:1.0:1788636628.101936:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207018880 00000100:00100000:1.0:1788636628.101955:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 102 00000100:00100000:1.0:1788636628.101965:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207019008:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636628.102458:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207018752 00000100:00100000:0.0:1788636628.102464:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207018752 00000100:00100000:0.0:1788636628.102501:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 283 00000100:00100000:0.0:1788636628.102509:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:2398:x1875521207018752:12345-192.168.202.26@tcp:400:kworker.0 00000100:00080000:3.0:1788636628.102592:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636628.102597:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636628.102635:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788636628.102645:0:6523:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788636628.102765:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 103 00000100:00100000:3.0:1788636628.102774:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207018880:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636628.102888:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207019008:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 922us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636628.102906:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 102 00000100:00100000:0.0:1788636628.104704:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:2398:x1875521207018752:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 2180us (4761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636628.104720:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 283 00000100:00100000:3.0:1788636628.105432:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207018880:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 2655us (5385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636628.105443:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 103 00010000:00010000:0.0:1788636628.373377:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636628.629260:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636628.629294:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225963648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636628.629377:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636628.629658:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225963648 00000100:00100000:1.0:1788636628.629667:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225963648 00000100:00100000:1.0:1788636628.629760:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788636628.629772:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225963648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636628.629828:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788636628.629890:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225963648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636628.629898:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788636628.629984:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225963648:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788636629.143643:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000020:00000080:0.0:1788636629.143653:0:8431:0:(genops.c:885:class_export_put()) final put ffff9cef034cd000/a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000020:00000080:2.0:1788636629.143745:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef034cd000/a3091a46-1ad5-4415-b7a7-5e4bfab40689 for lustre-OST0000 00000020:00000080:2.0:1788636629.143796:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef034cb000 for lustre-OST0000 00000001:00100000:3.0:1788636629.145438:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000020:00000080:3.0:1788636629.145446:0:9516:0:(genops.c:885:class_export_put()) final put ffff9cef033a3800/a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000020:00000080:1.0:1788636629.145533:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef033a3800/a3091a46-1ad5-4415-b7a7-5e4bfab40689 for lustre-OST0001 00000020:00000080:1.0:1788636629.145582:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef033a3000 for lustre-OST0001 00010000:00010000:1.0:1788636629.397119:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636630.165164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225963776:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.165238:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636630.165281:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225964288:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.165308:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636630.165311:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225964032:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.165325:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225964800:0@lo:400:kworker.0 00000100:00100000:3.0:1788636630.165336:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636630.165342:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636630.165354:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225964544:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.165355:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225965312:0@lo:400:kworker.0 00000100:00100000:3.0:1788636630.165375:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636630.165384:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636630.165391:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225965056:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.165405:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788636630.165409:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636630.165411:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225964160:0@lo:400:kworker.0 00000100:00100000:3.0:1788636630.165426:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788636630.165430:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225963904:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.165430:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636630.165444:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225964672:0@lo:400:kworker.0 00000100:00100000:3.0:1788636630.165447:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636630.165460:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521225964416:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.165473:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636630.165475:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636630.165484:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521225964928:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.165486:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225965184:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.165502:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636630.165516:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636630.165525:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225965440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636630.165537:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225963776 00000100:00100000:1.0:1788636630.165544:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225963776 00000100:00100000:3.0:1788636630.165556:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636630.165582:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225964288 00000100:00100000:3.0:1788636630.165585:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225964288 00000100:00100000:1.0:1788636630.165586:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788636630.165593:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521225963776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636630.165607:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225964032 00000100:00100000:3.0:1788636630.165615:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225964032 00000100:00100000:3.0:1788636630.165631:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788636630.165637:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225964288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.165638:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521225963776:12345-0@lo:400:kworker.0 Request processed in 46us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636630.165645:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788636630.165669:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225964288:12345-0@lo:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636630.165674:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788636630.165680:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225964032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.166039:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225964032:12345-0@lo:400:kworker.0 Request processed in 358us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636630.167871:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225964800 00000100:00100000:0.0:1788636630.167885:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225964800 00000100:00100000:3.0:1788636630.171141:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788636630.171464:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225964544 00000100:00100000:3.0:1788636630.171473:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225964544 00000100:00100000:3.0:1788636630.171973:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225965056 00000100:00100000:3.0:1788636630.171978:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225965056 00000100:00100000:3.0:1788636630.171994:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225964160 00000100:00100000:3.0:1788636630.171997:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225964160 00000100:00100000:3.0:1788636630.172007:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225963904 00000100:00100000:3.0:1788636630.172020:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225963904 00000100:00100000:3.0:1788636630.172034:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225964416 00000100:00100000:3.0:1788636630.172037:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225964416 00000100:00100000:3.0:1788636630.172049:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225964928 00000100:00100000:3.0:1788636630.172052:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225964928 00000100:00100000:0.0:1788636630.172053:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225965312 00000100:00100000:0.0:1788636630.172056:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225965312 00000100:00100000:3.0:1788636630.172068:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788636630.172077:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225964544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636630.172210:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225964672 00000100:00100000:0.0:1788636630.172214:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225964672 00000100:00100000:0.0:1788636630.172230:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225965184 00000100:00100000:0.0:1788636630.172233:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225965184 00000100:00100000:0.0:1788636630.172246:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788636630.172253:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225964800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636630.172304:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225964800:12345-0@lo:400:kworker.0 Request processed in 51us (6960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636630.172310:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788636630.172325:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788636630.172331:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225965312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636630.172603:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788636630.172612:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225965056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636630.172658:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225965056:12345-0@lo:400:kworker.0 Request processed in 48us (7247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636630.172665:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788636630.172678:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788636630.172685:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225964160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636630.172712:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225964160:12345-0@lo:400:kworker.0 Request processed in 28us (7282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636630.172718:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788636630.172728:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788636630.172734:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225963904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636630.172773:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225963904:12345-0@lo:400:kworker.0 Request processed in 39us (7324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636630.172779:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788636630.172790:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788636630.172795:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521225964416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636630.172840:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521225964416:12345-0@lo:400:kworker.0 Request processed in 44us (7363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636630.172846:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788636630.172858:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788636630.172864:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521225964928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636630.172891:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521225964928:12345-0@lo:400:kworker.0 Request processed in 27us (7373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636630.172896:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788636630.173233:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788636630.173277:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225965568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636630.173318:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636630.173373:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225964544:12345-0@lo:400:kworker.0 Request processed in 1297us (7995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636630.173380:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788636630.173404:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225965440 00000100:00100000:3.0:1788636630.173409:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225965440 00000100:00100000:3.0:1788636630.173431:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225965568 00000100:00100000:3.0:1788636630.173434:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225965568 00000100:00100000:0.0:1788636630.173441:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225965312:12345-0@lo:400:kworker.0 Request processed in 27us (6972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636630.173445:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788636630.173449:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788636630.173450:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875521225965440:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636630.173464:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788636630.173470:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225964672:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788636630.173474:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636630.173501:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225964672:12345-0@lo:400:kworker.0 Request processed in 33us (8028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636630.173514:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788636630.173527:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788636630.173533:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875521225965184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636630.173562:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875521225965184:12345-0@lo:400:kworker.0 Request processed in 30us (8059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636630.173568:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788636630.173634:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225964160:0@lo:400:kworker.0 00000100:00100000:3.0:1788636630.173668:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225965440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 216us (8110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636630.173674:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788636630.173686:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788636630.173693:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225965568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636630.173703:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636630.173725:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225965568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636630.173731:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788636630.173746:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636630.173752:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636630.173754:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636630.173756:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636630.174819:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225963904:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.174847:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521225964416:0@lo:400:kworker.0 00000100:00100000:1.0:1788636630.174859:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521225964928:0@lo:400:kworker.0 00010000:00080000:1.0:1788636630.174875:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0351a300 x1875521225965440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636630.174895:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225965440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636630.175463:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225964032:0@lo:400:kworker.0 00010000:00080000:1.0:1788636630.175482:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03650e00 x1875521225964544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636630.175491:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225964544:0@lo:400:kworker.0 00010000:00080000:1.0:1788636630.175506:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0237f100 x1875521225965056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636630.175515:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225965056:0@lo:400:kworker.0 00010000:00080000:1.0:1788636630.175555:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc3b80 x1875521225965568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636630.175569:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225965568:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788636630.175738:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03651f80 x1875521225964672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636630.175747:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225964672:0@lo:400:kworker.0 00010000:00080000:0.0:1788636630.175757:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0237c380 x1875521225965184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636630.175764:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225965184:0@lo:400:kworker.0 00000100:00100000:0.0:1788636630.175773:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225963776:0@lo:400:kworker.0 00000100:00100000:0.0:1788636630.175784:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225964288:0@lo:400:kworker.0 00010000:00080000:0.0:1788636630.175794:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf00f179c00 x1875521225964800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636630.175802:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225964800:0@lo:400:kworker.0 00010000:00080000:0.0:1788636630.175826:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0237c000 x1875521225965312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636630.175834:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225965312:0@lo:400:kworker.0 00010000:00010000:3.0:1788636630.421092:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788636630.558443:0:11126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:0.0:1788636631.449928:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636632.473728:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636632.725410:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225965696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636632.725520:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636632.725571:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636632.725576:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225965824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636632.725592:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636632.726010:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225965824 00000100:00100000:0.0:1788636632.726019:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225965824 00000100:00100000:0.0:1788636632.726070:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788636632.726080:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225965824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636632.726118:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636632.726174:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225965824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636632.726180:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788636632.727127:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225965824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636632.732219:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636632.732251:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225965952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636632.732335:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636632.732336:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225965696 00000100:00100000:2.0:1788636632.732346:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225965696 00000100:00100000:3.0:1788636632.732422:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225965952 00000100:00100000:3.0:1788636632.732427:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225965952 00000100:00100000:2.0:1788636632.732442:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788636632.732452:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225965696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636632.732488:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636632.732895:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225965696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 443us (7373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636632.732913:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788636632.733151:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636632.735861:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc1c00 x1875521225965696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636632.735889:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225965696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636632.737904:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788636632.737923:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225965952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636632.737967:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636632.738075:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225965952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (5738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636632.738083:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788636632.738155:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bf480 x1875521225965952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636632.738190:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225965952:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788636633.142156:0:11224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:0.0:1788636633.216208:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636633.217180:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207019136 00000100:00100000:3.0:1788636633.217200:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207019136 00000100:00100000:3.0:1788636633.217266:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 285 00000100:00100000:3.0:1788636633.217277:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207019136:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636633.217358:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207019136:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 84us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636633.217366:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 285 00000100:00100000:1.0:1788636633.218937:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636633.218981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636633.219058:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207019392 00000100:00100000:3.0:1788636633.219068:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207019392 00000100:00100000:3.0:1788636633.219138:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207019264 00000100:00100000:3.0:1788636633.219141:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207019264 00000100:00100000:3.0:1788636633.219174:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 110 00000100:00100000:3.0:1788636633.219187:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207019392:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636633.219277:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207019392:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 84us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636633.219285:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 110 00000100:00100000:3.0:1788636633.219307:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 111 00000100:00100000:3.0:1788636633.219314:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207019264:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636633.219342:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207019264:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 28us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636633.219348:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 111 00000100:00080000:1.0:1788636633.219865:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636633.219871:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788636633.493101:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636633.751091:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636633.751119:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225966080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636633.751195:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636633.751323:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225966080 00000100:00100000:1.0:1788636633.751333:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225966080 00000100:00100000:1.0:1788636633.751392:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788636633.751401:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225966080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636633.751437:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788636633.751488:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225966080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636633.751494:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788636633.751564:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225966080:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788636634.520425:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636635.285115:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225966208:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285205:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285249:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225966720:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285276:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285296:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225967232:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285319:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285340:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225967744:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285360:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285387:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788636635.285393:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225966336:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285416:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285435:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225966848:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285455:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285471:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225967360:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285518:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285554:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225966464:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285579:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285610:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225966976:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285629:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285641:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225967488:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285652:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285659:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788636635.285662:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225966592:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285684:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285690:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225967104:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285700:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285710:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225967616:0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285721:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636635.285744:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225966208 00000100:00100000:1.0:1788636635.285753:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225966208 00000100:00100000:1.0:1788636635.285802:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788636635.285840:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225966208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.285907:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225966208:12345-0@lo:400:kworker.0 Request processed in 67us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636635.285915:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788636635.285947:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225966720 00000100:00100000:1.0:1788636635.285951:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225966720 00000100:00100000:1.0:1788636635.285971:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225966464 00000100:00100000:1.0:1788636635.285974:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225966464 00000100:00100000:1.0:1788636635.285986:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788636635.285991:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225966720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.286027:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225966720:12345-0@lo:400:kworker.0 Request processed in 33us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636635.286033:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788636635.286045:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788636635.286050:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225966464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.286079:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225966464:12345-0@lo:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636635.286085:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788636635.286109:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225967232 00000100:00100000:1.0:1788636635.286113:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225967232 00000100:00100000:0.0:1788636635.286353:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636635.286365:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225968000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636635.286395:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636635.286423:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225968000 00000100:00100000:0.0:1788636635.286427:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225968000 00000100:00100000:1.0:1788636635.286579:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225967744 00000100:00100000:1.0:1788636635.286583:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225967744 00000100:00100000:1.0:1788636635.286607:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225967104 00000100:00100000:1.0:1788636635.286610:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225967104 00000100:00080000:3.0:1788636635.286686:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636635.286691:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636635.286763:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788636635.286772:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521225968000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636635.286801:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636635.286887:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521225968000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636635.286894:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788636635.286936:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320f480 x1875521225968000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636635.286968:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225968000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636635.287896:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225967616 00000100:00100000:3.0:1788636635.287906:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225967616 00000100:00100000:3.0:1788636635.287946:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636635.287967:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225967232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636635.288032:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225967232:12345-0@lo:400:kworker.0 Request processed in 78us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636635.288039:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636635.288053:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788636635.288058:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225967744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636635.288085:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225967744:12345-0@lo:400:kworker.0 Request processed in 27us (2723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636635.288091:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788636635.288101:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788636635.288107:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225967616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636635.288134:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225967616:12345-0@lo:400:kworker.0 Request processed in 27us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636635.288139:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788636635.288158:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225966336 00000100:00100000:3.0:1788636635.288162:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225966336 00000100:00100000:3.0:1788636635.288178:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225966848 00000100:00100000:3.0:1788636635.288181:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225966848 00000100:00100000:3.0:1788636635.288193:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225967360 00000100:00100000:3.0:1788636635.288196:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225967360 00000100:00100000:3.0:1788636635.288207:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225966976 00000100:00100000:3.0:1788636635.288209:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225966976 00000100:00100000:3.0:1788636635.288220:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225967488 00000100:00100000:3.0:1788636635.288222:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225967488 00000100:00100000:3.0:1788636635.288232:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225966592 00000100:00100000:3.0:1788636635.288234:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225966592 00000100:00100000:3.0:1788636635.288246:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788636635.288252:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225966336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636635.288283:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225966336:12345-0@lo:400:kworker.0 Request processed in 31us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636635.288297:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788636635.288309:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788636635.288315:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225966848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636635.288345:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225966848:12345-0@lo:400:kworker.0 Request processed in 31us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636635.288351:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788636635.288361:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788636635.288367:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225967360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636635.288394:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225967360:12345-0@lo:400:kworker.0 Request processed in 28us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636635.288399:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788636635.288409:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788636635.288415:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225966976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636635.288440:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225966976:12345-0@lo:400:kworker.0 Request processed in 25us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636635.288445:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788636635.288456:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788636635.288461:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225967488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636635.288486:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225967488:12345-0@lo:400:kworker.0 Request processed in 26us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636635.288492:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788636635.288503:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788636635.288508:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225966592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636635.288534:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225966592:12345-0@lo:400:kworker.0 Request processed in 26us (2848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636635.288545:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1788636635.288579:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636635.288582:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636635.288585:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636635.290132:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225967872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636635.290186:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636635.290244:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225966592:0@lo:400:kworker.0 00010000:00080000:3.0:1788636635.290259:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03651500 x1875521225967616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636635.290269:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225967616:0@lo:400:kworker.0 00000100:00100000:3.0:1788636635.290280:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225966464:0@lo:400:kworker.0 00010000:00080000:3.0:1788636635.290290:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0237c700 x1875521225966976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636635.290297:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225966976:0@lo:400:kworker.0 00010000:00080000:3.0:1788636635.290307:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03651180 x1875521225967488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636635.290316:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225967488:0@lo:400:kworker.0 00000100:00100000:0.0:1788636635.290371:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225966336:0@lo:400:kworker.0 00000100:00100000:0.0:1788636635.290386:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225966848:0@lo:400:kworker.0 00000100:00100000:0.0:1788636635.290396:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225967360:0@lo:400:kworker.0 00000100:00100000:0.0:1788636635.290407:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225966208:0@lo:400:kworker.0 00000100:00100000:0.0:1788636635.290418:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225966720:0@lo:400:kworker.0 00010000:00080000:0.0:1788636635.290429:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0237c380 x1875521225967232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636635.290434:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225967232:0@lo:400:kworker.0 00010000:00080000:0.0:1788636635.290441:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03651f80 x1875521225967744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636635.290445:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225967744:0@lo:400:kworker.0 00000100:00100000:0.0:1788636635.290469:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225967872 00000100:00100000:0.0:1788636635.290473:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225967872 00000100:00100000:0.0:1788636635.290516:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788636635.290524:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225967872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636635.290543:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636635.290656:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225967872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636635.290661:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788636635.290744:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bf480 x1875521225967872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636635.290758:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225967872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636635.291798:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788636635.291825:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225967104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636635.291901:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225967104:12345-0@lo:400:kworker.0 Request processed in 94us (6197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636635.291908:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788636635.291948:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0237c000 x1875521225967104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636635.292089:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225967104:0@lo:400:kworker.0 00010000:00010000:0.0:1788636635.546338:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788636635.548247:0:11321:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:3.0:1788636636.568353:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788636637.346797:0:11369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 15:30:36 EDT 2026 00010000:00010000:0.0:1788636637.589205:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636637.845109:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636637.845139:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225968128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636637.845250:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636637.845522:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225968128 00000100:00100000:2.0:1788636637.845534:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225968128 00000100:00100000:2.0:1788636637.845613:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788636637.845627:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225968128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636637.845678:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636637.845749:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225968128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636637.845757:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788636637.847880:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225968256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636637.847962:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636637.848068:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225968256 00000100:00100000:2.0:1788636637.848078:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225968256 00000100:00100000:1.0:1788636637.848151:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225968128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636637.848166:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788636637.848179:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225968256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636637.848216:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636637.848272:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225968256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636637.848278:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788636637.848622:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636637.848850:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03731500 x1875521225968256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636637.848868:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225968256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636637.850098:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636637.850128:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225968384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636637.850221:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636637.850296:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225968384 00000100:00100000:0.0:1788636637.850307:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225968384 00000100:00100000:0.0:1788636637.850386:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788636637.850397:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225968384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636637.850437:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636637.850489:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225968384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636637.850496:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788636637.850614:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636637.850702:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc3b80 x1875521225968384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636637.850729:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225968384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636638.332965:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636638.333525:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636638.333733:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207019648 00000100:00100000:2.0:1788636638.333748:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207019648 00000100:00100000:2.0:1788636638.333908:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 118 00000100:00100000:2.0:1788636638.333923:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207019648:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636638.334033:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207019648:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 114us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636638.334042:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 118 00000100:00100000:1.0:1788636638.334179:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207019520 00000100:00100000:1.0:1788636638.334185:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207019520 00000100:00100000:1.0:1788636638.334237:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 287 00000100:00100000:1.0:1788636638.334246:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:2399:x1875521207019520:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636638.334306:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:2399:x1875521207019520:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 62us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636638.334314:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 287 00000100:00080000:0.0:1788636638.335224:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636638.339014:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636638.339358:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207019776 00000100:00100000:0.0:1788636638.339373:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207019776 00000100:00100000:0.0:1788636638.339501:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 119 00000100:00100000:0.0:1788636638.339516:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207019776:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636638.339640:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207019776:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 127us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636638.339648:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 119 00000100:00080000:1.0:1788636638.340482:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788636638.622884:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636638.870708:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636638.870746:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225968512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636638.870884:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636638.871566:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225968512 00000100:00100000:3.0:1788636638.871581:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225968512 00000100:00100000:3.0:1788636638.871645:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788636638.871656:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225968512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636638.871700:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788636638.871787:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225968512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636638.871795:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788636638.871882:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225968512:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788636639.641045:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636640.405068:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636640.405085:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225968768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636640.405085:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225968640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636640.406871:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225969024:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.409594:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.409677:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225969152:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.409733:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.409757:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225969664:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.409782:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.409803:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225970176:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.409850:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.409894:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225969664 00000100:00100000:2.0:1788636640.409902:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225969664 00000100:00100000:2.0:1788636640.409974:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225970176 00000100:00100000:2.0:1788636640.409977:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225970176 00000100:00100000:2.0:1788636640.410005:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788636640.410013:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225969664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.410071:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225969664:12345-0@lo:400:kworker.0 Request processed in 58us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636640.410092:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788636640.410263:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788636640.410271:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225970176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.410307:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225970176:12345-0@lo:400:kworker.0 Request processed in 37us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636640.410313:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1788636640.410357:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03656d80 x1875521225969664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636640.410372:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225969664:0@lo:400:kworker.0 00010000:00080000:2.0:1788636640.410382:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03656a00 x1875521225970176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636640.410390:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225970176:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.410439:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225969280:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.410465:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.410484:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225969792:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.410504:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.410532:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225970304:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.410551:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.410577:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788636640.410584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225968896:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.410614:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.410633:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225969408:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.410657:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.410686:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225969920:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.410870:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.410893:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225970432:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.410916:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.410942:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225969280 00000100:00100000:2.0:1788636640.410947:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225969280 00000100:00100000:2.0:1788636640.410972:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788636640.410978:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225969280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.411014:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225969280:12345-0@lo:400:kworker.0 Request processed in 36us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636640.411021:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788636640.411039:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225969152 00000100:00100000:2.0:1788636640.411043:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225969152 00000100:00100000:2.0:1788636640.411063:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225969408 00000100:00100000:2.0:1788636640.411066:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225969408 00000100:00100000:2.0:1788636640.411078:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788636640.411083:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225969152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636640.411245:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225968640 00000100:00100000:0.0:1788636640.411250:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225968640 00000100:00100000:0.0:1788636640.411292:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788636640.411301:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225968640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636640.411326:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636640.411368:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225968640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636640.411374:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788636640.411394:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788636640.411401:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225969408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636640.411431:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225969408:12345-0@lo:400:kworker.0 Request processed in 31us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636640.411437:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788636640.411457:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225969792 00000100:00100000:0.0:1788636640.411461:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225969792 00000100:00100000:0.0:1788636640.411486:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225970304 00000100:00100000:0.0:1788636640.411489:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225970304 00000100:00100000:0.0:1788636640.411502:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225969920 00000100:00100000:0.0:1788636640.411504:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225969920 00000100:00100000:0.0:1788636640.411515:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225970432 00000100:00100000:0.0:1788636640.411518:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225970432 00000100:00100000:0.0:1788636640.411530:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636640.411536:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225969792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636640.411567:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225969792:12345-0@lo:400:kworker.0 Request processed in 32us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636640.411573:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636640.411585:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788636640.411590:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225970304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636640.411615:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225970304:12345-0@lo:400:kworker.0 Request processed in 25us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636640.411630:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788636640.411643:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788636640.411648:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225969920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636640.411676:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225969920:12345-0@lo:400:kworker.0 Request processed in 28us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636640.411682:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788636640.411704:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788636640.411711:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225970432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636640.411750:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225970432:12345-0@lo:400:kworker.0 Request processed in 40us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636640.411755:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788636640.411773:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225968896 00000100:00100000:0.0:1788636640.411776:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225968896 00000100:00100000:0.0:1788636640.411801:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788636640.411831:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225968896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636640.411860:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225968896:12345-0@lo:400:kworker.0 Request processed in 54us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636640.411866:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00010000:00080000:0.0:1788636640.411920:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0351a300 x1875521225968640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636640.411936:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225968640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636640.412217:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225969152:12345-0@lo:400:kworker.0 Request processed in 1024us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636640.412225:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788636640.412262:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225968896:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.412272:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225969408:0@lo:400:kworker.0 00010000:00080000:2.0:1788636640.412282:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03655180 x1875521225969920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636640.412291:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225969920:0@lo:400:kworker.0 00010000:00080000:2.0:1788636640.412312:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03654a80 x1875521225970432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636640.412320:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225970432:0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.412329:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225969280:0@lo:400:kworker.0 00010000:00080000:2.0:1788636640.412337:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03655500 x1875521225969792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636640.412345:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225969792:0@lo:400:kworker.0 00010000:00080000:2.0:1788636640.412353:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657100 x1875521225970304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636640.412360:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225970304:0@lo:400:kworker.0 00000100:00080000:2.0:1788636640.412621:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636640.412626:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636640.412629:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636640.412725:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225969152:0@lo:400:kworker.0 00000100:00100000:3.0:1788636640.414201:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636640.414354:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225968768 00000100:00100000:0.0:1788636640.414363:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225968768 00000100:00100000:0.0:1788636640.414446:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636640.414456:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225968768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636640.414484:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636640.414539:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225968768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636640.414546:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788636640.414707:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bea00 x1875521225968768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636656 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636640.414727:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225968768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636640.415878:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636640.415963:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225969536:0@lo:400:kworker.0 00000100:00100000:1.0:1788636640.415992:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636640.418539:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521225970048:0@lo:400:kworker.0 00000100:00100000:1.0:1788636640.418610:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636640.425379:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225969024 00000100:00100000:2.0:1788636640.425398:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225969024 00000100:00100000:2.0:1788636640.425490:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225969536 00000100:00100000:2.0:1788636640.425494:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225969536 00000100:00100000:2.0:1788636640.425536:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788636640.425547:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225969024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.425643:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225969024:12345-0@lo:400:kworker.0 Request processed in 98us (9768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636640.425650:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788636640.425668:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788636640.425675:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225969536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636640.425897:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225969536:12345-0@lo:400:kworker.0 Request processed in 221us (9902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636640.425904:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1788636640.425925:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636640.426120:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225969024:0@lo:400:kworker.0 00000100:00100000:1.0:1788636640.426136:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225969536:0@lo:400:kworker.0 00000100:00100000:0.0:1788636640.426298:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225970048 00000100:00100000:0.0:1788636640.426303:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225970048 00000100:00100000:0.0:1788636640.426355:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788636640.426363:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521225970048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636640.426402:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521225970048:12345-0@lo:400:kworker.0 Request processed in 41us (7792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636640.426408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788636640.427903:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636640.428081:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521225970048:0@lo:400:kworker.0 00010000:00010000:0.0:1788636640.661961:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636641.686116:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636642.716410:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636642.965383:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636642.965424:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225970560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636642.965530:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636642.965628:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225970560 00000100:00100000:3.0:1788636642.965640:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225970560 00000100:00100000:3.0:1788636642.965721:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788636642.965735:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225970560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636642.965798:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636642.965905:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225970560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636642.965913:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788636642.965987:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bea00 x1875521225970560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636642.966014:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225970560:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788636642.966869:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636642.967182:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636642.967196:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225970688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636642.967259:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636642.967316:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225970688 00000100:00100000:0.0:1788636642.967324:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225970688 00000100:00100000:0.0:1788636642.967376:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788636642.967386:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225970688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788636642.967409:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636642.967455:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225970688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636642.967462:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788636642.967482:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636642.967532:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03654e00 x1875521225970688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636642.967550:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225970688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636642.973181:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225970816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636642.973287:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636642.973374:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225970816 00000100:00100000:3.0:1788636642.973383:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225970816 00000100:00100000:3.0:1788636642.973445:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788636642.973457:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225970816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788636642.973504:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788636642.973559:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225970816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636642.973567:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788636642.973640:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225970816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636643.463978:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636643.464214:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636643.464256:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636643.464522:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207019904 00000100:00100000:1.0:1788636643.464537:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207019904 00000100:00100000:1.0:1788636643.464629:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 289 00000100:00100000:1.0:1788636643.464641:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:2401:x1875521207019904:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636643.464912:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:2401:x1875521207019904:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 273us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636643.464922:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 289 00000100:00100000:0.0:1788636643.465112:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207020032 00000100:00100000:0.0:1788636643.465118:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207020032 00000100:00100000:0.0:1788636643.465180:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207020160 00000100:00100000:0.0:1788636643.465184:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207020160 00000100:00100000:0.0:1788636643.465214:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 126 00000100:00100000:0.0:1788636643.465222:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207020032:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636643.465267:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207020032:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 46us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636643.465275:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 126 00000100:00100000:0.0:1788636643.465289:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 127 00000100:00100000:0.0:1788636643.465297:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207020160:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636643.465321:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207020160:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 27us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636643.465328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 127 00000100:00080000:0.0:1788636643.465345:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636643.465351:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788636643.736475:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636643.994530:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636643.999322:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225970944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636643.999497:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636643.999623:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225970944 00000100:00100000:2.0:1788636643.999636:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225970944 00000100:00100000:2.0:1788636643.999710:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788636643.999722:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225970944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788636643.999774:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788636643.999986:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225970944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 265us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636643.999994:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788636644.001935:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225970944:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788636644.761008:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636645.528182:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225971072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636645.528299:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636645.528370:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225971584:0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.528428:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636645.528446:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225972096:0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.528469:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636645.528483:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225972608:0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.528500:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636645.529070:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225971200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636645.529127:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636645.529170:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225971712:0@lo:400:kworker.0 00000100:00100000:1.0:1788636645.529194:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636645.529212:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225972224:0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.529214:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225971584 00000100:00100000:2.0:1788636645.529224:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225971584 00000100:00100000:1.0:1788636645.529234:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636645.529253:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225972736:0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.529375:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788636645.529388:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225971584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.529466:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225972096 00000100:00100000:2.0:1788636645.529467:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225971584:12345-0@lo:400:kworker.0 Request processed in 81us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636645.529470:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225972096 00000100:00100000:2.0:1788636645.529476:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788636645.529518:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225972608 00000100:00100000:3.0:1788636645.529521:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225972608 00000100:00100000:3.0:1788636645.529548:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225971712 00000100:00100000:3.0:1788636645.529551:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225971712 00000100:00100000:3.0:1788636645.529564:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788636645.529570:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225972096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.529605:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225972096:12345-0@lo:400:kworker.0 Request processed in 36us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636645.529612:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788636645.529625:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788636645.529641:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225972608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.529666:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225972608:12345-0@lo:400:kworker.0 Request processed in 36us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636645.529672:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788636645.529682:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788636645.529687:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225971712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.529710:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225971712:12345-0@lo:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636645.529715:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788636645.529744:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636645.530062:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225971584:0@lo:400:kworker.0 00010000:00080000:3.0:1788636645.530110:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bd880 x1875521225972096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636645.530125:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225972096:0@lo:400:kworker.0 00010000:00080000:3.0:1788636645.530152:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03651500 x1875521225972608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636645.530162:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225972608:0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.530235:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225971456:0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.530276:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225971328:0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.531347:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636645.531428:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225971840:0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.531464:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636645.531491:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225972352:0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.531518:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636645.531573:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225972864:0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.531600:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636645.531650:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225971840 00000100:00100000:2.0:1788636645.531660:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225971840 00000100:00100000:2.0:1788636645.531725:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788636645.531736:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225971840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.531830:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225971840:12345-0@lo:400:kworker.0 Request processed in 74us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636645.531837:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788636645.531863:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225971328 00000100:00100000:2.0:1788636645.531867:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225971328 00000100:00100000:2.0:1788636645.531898:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788636645.531905:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225971328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.531950:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225971328:12345-0@lo:400:kworker.0 Request processed in 46us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636645.531957:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788636645.533959:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225972224 00000100:00100000:2.0:1788636645.533972:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225972224 00000100:00100000:2.0:1788636645.534886:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225972352 00000100:00100000:2.0:1788636645.534897:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225972352 00000100:00100000:2.0:1788636645.534927:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225972864 00000100:00100000:2.0:1788636645.534930:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225972864 00000100:00100000:2.0:1788636645.534953:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788636645.534964:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225972224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.536215:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225972224:12345-0@lo:400:kworker.0 Request processed in 1251us (6976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636645.536225:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788636645.536252:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788636645.536277:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225972352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.536313:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225972352:12345-0@lo:400:kworker.0 Request processed in 39us (4794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636645.536320:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788636645.536331:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788636645.536337:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225972864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.536365:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225972864:12345-0@lo:400:kworker.0 Request processed in 29us (4764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636645.536371:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788636645.536408:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636645.536414:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636645.536460:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225971328:0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.536480:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225971840:0@lo:400:kworker.0 00010000:00080000:2.0:1788636645.536494:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03651f80 x1875521225972352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636645.536504:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225972352:0@lo:400:kworker.0 00010000:00080000:2.0:1788636645.536515:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0237c380 x1875521225972864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636645.536523:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225972864:0@lo:400:kworker.0 00000100:00100000:2.0:1788636645.536604:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225971072 00000100:00100000:2.0:1788636645.536610:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225971072 00000100:00100000:2.0:1788636645.536645:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225971200 00000100:00100000:2.0:1788636645.536649:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225971200 00000100:00100000:2.0:1788636645.536660:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788636645.536667:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225971072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636645.536699:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636645.537450:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225971072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 778us (9146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636645.537460:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788636645.537486:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788636645.537495:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225971200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636645.537514:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636645.537559:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225971200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (8431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636645.537567:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788636645.537589:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788636645.537657:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bdf80 x1875521225971072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636645.537680:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225971072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636645.537826:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788636645.537914:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03730380 x1875521225971200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636645.537940:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225971200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636645.538080:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225971712:0@lo:400:kworker.0 00010000:00080000:1.0:1788636645.538108:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bd180 x1875521225972224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636645.538118:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225972224:0@lo:400:kworker.0 00000100:00100000:1.0:1788636645.538180:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225972736 00000100:00100000:1.0:1788636645.538188:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225972736 00000100:00100000:1.0:1788636645.538237:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788636645.538246:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225972736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636645.538314:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225972736:12345-0@lo:400:kworker.0 Request processed in 68us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636645.538322:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788636645.538377:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0237c000 x1875521225972736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636645.538388:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225972736:0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.541878:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636645.542086:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225971968:0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.542216:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636645.548113:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225972480:0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.548199:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636645.548472:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225971456 00000100:00100000:2.0:1788636645.548491:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225971456 00000100:00100000:1.0:1788636645.550668:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225971968 00000100:00100000:1.0:1788636645.551325:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225971968 00000100:00100000:1.0:1788636645.551408:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225972480 00000100:00100000:1.0:1788636645.551411:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225972480 00000100:00100000:1.0:1788636645.551439:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788636645.551451:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225971456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636645.551562:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225971456:12345-0@lo:400:kworker.0 Request processed in 113us (9698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636645.551572:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788636645.551591:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788636645.551597:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225971968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636645.551627:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225971968:12345-0@lo:400:kworker.0 Request processed in 31us (9412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636645.551634:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788636645.551646:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788636645.551652:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225972480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636645.551679:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225972480:12345-0@lo:400:kworker.0 Request processed in 28us (3482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636645.551697:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1788636645.551733:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636645.551748:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225971456:0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.551763:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225971968:0@lo:400:kworker.0 00000100:00100000:3.0:1788636645.551773:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225972480:0@lo:400:kworker.0 00010000:00010000:0.0:1788636645.782469:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636646.805049:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636647.845652:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636648.084981:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636648.085006:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225972992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636648.085075:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636648.085268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225973120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636648.085298:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636648.085466:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225973248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636648.085495:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636648.085530:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225972992 00000100:00100000:1.0:1788636648.085537:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225972992 00000100:00100000:1.0:1788636648.085599:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225973120 00000100:00100000:1.0:1788636648.085610:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225973120 00000100:00100000:1.0:1788636648.085629:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788636648.085637:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225972992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636648.085665:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636648.085706:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225972992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636648.085714:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788636648.085729:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788636648.085735:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225973120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636648.085744:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636648.085766:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225973120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636648.085772:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788636648.085789:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225973248 00000100:00100000:1.0:1788636648.085792:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225973248 00000100:00100000:1.0:1788636648.085844:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788636648.085851:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225973248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788636648.085873:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788636648.085906:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225973248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636648.085913:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1788636648.085927:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636648.085960:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225973248:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788636648.085988:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657800 x1875521225972992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636648.086000:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225972992:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788636648.086482:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0237ce00 x1875521225973120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636648.086515:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225973120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636648.572739:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636648.572781:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636648.572892:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207020288 00000100:00100000:1.0:1788636648.572905:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207020288 00000100:00100000:1.0:1788636648.572965:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 291 00000100:00100000:1.0:1788636648.572975:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207020288:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636648.573267:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207020288:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 293us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636648.573276:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 291 00000100:00100000:1.0:1788636648.579084:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636648.591136:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207020544 00000100:00100000:0.0:1788636648.591151:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207020544 00000100:00100000:3.0:1788636648.596616:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207020416 00000100:00100000:3.0:1788636648.596641:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207020416 00000100:00100000:3.0:1788636648.596841:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 134 00000100:00100000:3.0:1788636648.596855:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207020416:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636648.596944:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207020416:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 93us (17874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636648.596952:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 134 00000100:00080000:3.0:1788636648.596978:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636648.601383:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 135 00000100:00100000:1.0:1788636648.601397:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207020544:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636648.601507:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207020544:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 112us (28724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636648.601581:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 135 00000100:00080000:3.0:1788636648.603065:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788636648.864656:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636649.113830:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636649.118195:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225973376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636649.118275:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636649.118706:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225973376 00000100:00100000:0.0:1788636649.118716:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225973376 00000100:00100000:0.0:1788636649.118854:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788636649.118867:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225973376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636649.118911:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788636649.118971:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225973376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636649.118978:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788636649.119149:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225973376:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788636649.888645:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636650.645018:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225973504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636650.645091:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636650.645305:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225973504 00000100:00100000:1.0:1788636650.645312:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225973504 00000100:00100000:1.0:1788636650.645366:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788636650.645385:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225973504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636650.645415:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636650.645463:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225973504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636650.645482:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788636650.645503:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636650.645511:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225973632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636650.645538:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788636650.645564:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636650.645586:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225973632 00000100:00100000:1.0:1788636650.645590:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225973632 00000100:00100000:1.0:1788636650.645612:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788636650.645618:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225973632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636650.645627:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636650.645654:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225973632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636650.645659:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788636650.645672:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788636650.645695:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03733100 x1875521225973632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636650.645713:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225973632:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788636650.645745:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03731500 x1875521225973504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636650.645756:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225973504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636650.646106:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225974016:0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646144:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636650.646164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521225974528:0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646187:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636650.646205:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521225975040:0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646228:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636650.646247:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788636650.646252:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225973888:0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646268:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636650.646281:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225974400:0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646304:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636650.646323:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225974912:0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646337:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636650.646358:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225974016 00000100:00100000:1.0:1788636650.646361:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225974016 00000100:00100000:1.0:1788636650.646398:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788636650.646404:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225974016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646442:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225974016:12345-0@lo:400:kworker.0 Request processed in 38us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636650.646448:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788636650.646462:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225974528 00000100:00100000:1.0:1788636650.646465:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225974528 00000100:00100000:1.0:1788636650.646493:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225975040 00000100:00100000:1.0:1788636650.646496:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225975040 00000100:00100000:1.0:1788636650.646505:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225973888 00000100:00100000:1.0:1788636650.646507:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225973888 00000100:00100000:1.0:1788636650.646515:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225974400 00000100:00100000:1.0:1788636650.646517:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225974400 00000100:00100000:1.0:1788636650.646524:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225974912 00000100:00100000:1.0:1788636650.646526:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225974912 00000100:00100000:1.0:1788636650.646535:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788636650.646540:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521225974528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646563:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521225974528:12345-0@lo:400:kworker.0 Request processed in 23us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636650.646568:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788636650.646576:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788636650.646581:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521225975040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646598:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521225975040:12345-0@lo:400:kworker.0 Request processed in 17us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636650.646608:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788636650.646616:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788636650.646621:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225973888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646646:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225973888:12345-0@lo:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636650.646652:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788636650.646662:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788636650.646668:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225974400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646857:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225974400:12345-0@lo:400:kworker.0 Request processed in 189us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636650.646863:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788636650.646875:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788636650.646881:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225974912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646906:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225974912:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636650.646912:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1788636650.646933:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636650.646936:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636650.646958:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225973888:0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646968:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225974400:0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646975:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225974912:0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.646983:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225974016:0@lo:400:kworker.0 00010000:00080000:1.0:1788636650.646994:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef019b0a80 x1875521225974528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636650.647010:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521225974528:0@lo:400:kworker.0 00010000:00080000:1.0:1788636650.647021:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc7800 x1875521225975040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636650.647029:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521225975040:0@lo:400:kworker.0 00000100:00100000:3.0:1788636650.647158:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225973760:0@lo:400:kworker.0 00000100:00100000:3.0:1788636650.647193:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636650.647220:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225974272:0@lo:400:kworker.0 00000100:00100000:3.0:1788636650.647245:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636650.647265:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225974784:0@lo:400:kworker.0 00000100:00100000:3.0:1788636650.647287:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636650.647310:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788636650.647316:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225974144:0@lo:400:kworker.0 00000100:00100000:3.0:1788636650.647336:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636650.647351:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225974656:0@lo:400:kworker.0 00000100:00100000:3.0:1788636650.647394:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636650.647588:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225973760 00000100:00100000:1.0:1788636650.647594:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225973760 00000100:00100000:1.0:1788636650.647624:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788636650.647630:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225973760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.647670:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225973760:12345-0@lo:400:kworker.0 Request processed in 40us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636650.647676:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788636650.647699:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225974144 00000100:00100000:1.0:1788636650.647702:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225974144 00000100:00100000:1.0:1788636650.647720:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788636650.647725:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225974144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.647749:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225974144:12345-0@lo:400:kworker.0 Request processed in 24us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636650.647754:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788636650.647779:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225974144:0@lo:400:kworker.0 00000100:00100000:1.0:1788636650.647787:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225973760:0@lo:400:kworker.0 00000100:00100000:2.0:1788636650.647917:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225974784 00000100:00100000:2.0:1788636650.647921:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225974784 00000100:00100000:2.0:1788636650.647960:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225974656 00000100:00100000:2.0:1788636650.647969:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225974656 00000100:00100000:2.0:1788636650.647993:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788636650.648000:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225974784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636650.648038:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225974784:12345-0@lo:400:kworker.0 Request processed in 38us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636650.648043:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788636650.648055:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788636650.648060:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225974656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636650.648083:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225974656:12345-0@lo:400:kworker.0 Request processed in 23us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636650.648089:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1788636650.648135:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03731500 x1875521225974656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636650.648146:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225974656:0@lo:400:kworker.0 00010000:00080000:2.0:1788636650.648156:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03733100 x1875521225974784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636650.648163:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225974784:0@lo:400:kworker.0 00000100:00080000:1.0:1788636650.648272:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636650.648447:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225974272 00000100:00100000:0.0:1788636650.648452:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225974272 00000100:00100000:0.0:1788636650.648749:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788636650.648758:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225974272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636650.648834:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225974272:12345-0@lo:400:kworker.0 Request processed in 78us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636650.648841:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788636650.648911:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225974272:0@lo:400:kworker.0 00010000:00010000:3.0:1788636650.902345:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636651.927301:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636652.949163:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636653.205405:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225975168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636653.205512:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636653.205691:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225975168 00000100:00100000:1.0:1788636653.205703:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225975168 00000100:00100000:1.0:1788636653.205787:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788636653.205848:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225975168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788636653.205902:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788636653.205966:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225975168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636653.205974:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788636653.206039:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225975168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636653.206268:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636653.206277:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225975296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636653.206326:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636653.206369:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225975296 00000100:00100000:1.0:1788636653.206374:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225975296 00000100:00100000:1.0:1788636653.206417:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788636653.206425:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225975296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636653.206453:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636653.206490:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225975296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636653.206497:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788636653.206514:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636653.206542:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc7800 x1875521225975296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636653.206560:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225975296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636653.206928:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636653.207021:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225975424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636653.207063:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636653.207161:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225975424 00000100:00100000:1.0:1788636653.207166:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225975424 00000100:00100000:1.0:1788636653.207244:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788636653.207253:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225975424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636653.207276:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636653.207343:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225975424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636653.207350:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788636653.207426:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657100 x1875521225975424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636653.207441:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225975424:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788636653.207589:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636653.698412:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636653.698492:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636653.698530:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636653.698573:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207020800 00000100:00100000:0.0:1788636653.698574:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207020672 00000100:00100000:1.0:1788636653.698589:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207020800 00000100:00100000:0.0:1788636653.698592:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207020672 00000100:00100000:1.0:1788636653.698655:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207020928 00000100:00100000:1.0:1788636653.698658:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207020928 00000100:00100000:0.0:1788636653.698662:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 293 00000100:00100000:0.0:1788636653.698674:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207020672:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636653.698681:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 142 00000100:00100000:1.0:1788636653.698687:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207020800:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636653.699351:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 143 00000100:00100000:3.0:1788636653.699366:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207020928:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636653.699509:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+10:2400:x1875521207020672:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 836us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636653.699634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 293 00000100:00100000:1.0:1788636653.703605:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207020800:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 4900us (5195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636653.703625:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 142 00000100:00080000:1.0:1788636653.703686:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636653.703695:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636653.708915:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207020928:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 9535us (10365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636653.709198:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 143 00000001:02000400:0.0:1788636653.821363:0:11999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:30:52 (1788636652) === 00010000:00010000:3.0:1788636653.974202:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636654.229109:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636654.229146:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225975552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636654.229482:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636654.229640:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225975552 00000100:00100000:1.0:1788636654.229652:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225975552 00000100:00100000:1.0:1788636654.229725:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788636654.229737:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225975552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636654.229788:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788636654.229896:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225975552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636654.229904:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788636654.231142:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225975552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636654.292314:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636654.292645:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207021056 00000100:00100000:1.0:1788636654.292659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207021056 00000100:00100000:1.0:1788636654.292783:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 294 00000100:00100000:1.0:1788636654.292836:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+10:8729:x1875521207021056:12345-192.168.202.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788636654.292859:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636654.292884:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e83830b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38ee1 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636654.292927:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e83830b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ee1 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636654.292941:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e83830b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ee1 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636654.292955:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37000, rc 0) 00000100:00100000:1.0:1788636654.293043:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+11:8729:x1875521207021056:12345-192.168.202.26@tcp:101:mount.lustre.0 Request processed in 211us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636654.293051:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 294 00000100:00100000:3.0:1788636654.296046:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.296192:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207021184 00000100:00100000:0.0:1788636654.296206:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207021184 00000100:00100000:0.0:1788636654.296305:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 295 00000100:00100000:0.0:1788636654.296318:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+11:8729:x1875521207021184:12345-192.168.202.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788636654.296701:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+11:8729:x1875521207021184:12345-192.168.202.26@tcp:501:mount.lustre.0 Request processed in 383us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636654.296711:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 295 00000100:00100000:3.0:1788636654.305560:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636654.305859:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207021312 00000100:00100000:1.0:1788636654.305873:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207021312 00000100:00100000:1.0:1788636654.305954:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 296 00000100:00100000:1.0:1788636654.305967:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+11:8729:x1875521207021312:12345-192.168.202.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788636654.306196:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+11:8729:x1875521207021312:12345-192.168.202.26@tcp:503:mount.lustre.0 Request processed in 232us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636654.306205:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 296 00000100:00100000:2.0:1788636654.313769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.315972:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207021440 00000100:00100000:0.0:1788636654.316012:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207021440 00000100:00100000:0.0:1788636654.316119:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 297 00000100:00100000:0.0:1788636654.316133:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+11:8733:x1875521207021440:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636654.316545:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+11:8733:x1875521207021440:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 413us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636654.316555:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 297 00000100:00100000:2.0:1788636654.346540:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636654.346695:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207021568 00000100:00100000:3.0:1788636654.346709:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207021568 00000100:00100000:3.0:1788636654.346789:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 298 00000100:00100000:3.0:1788636654.346803:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+11:8733:x1875521207021568:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636654.347077:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+11:8733:x1875521207021568:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 276us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636654.347085:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 298 00000100:00100000:3.0:1788636654.359620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636654.359752:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207021696 00000100:00100000:1.0:1788636654.359766:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207021696 00000100:00100000:1.0:1788636654.359871:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 299 00000100:00100000:1.0:1788636654.359884:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+11:8733:x1875521207021696:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788636654.360128:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+11:8733:x1875521207021696:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 244us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636654.360145:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 299 00000100:00100000:2.0:1788636654.365056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.366057:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207021824 00000100:00100000:0.0:1788636654.366076:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207021824 00000100:00100000:0.0:1788636654.366218:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 300 00000100:00100000:0.0:1788636654.366232:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+11:8729:x1875521207021824:12345-192.168.202.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636654.366301:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636654.366326:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6800/0x5b741ef42e838312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f12 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636654.366385:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6800/0x5b741ef42e838312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f12 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636654.366401:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6800/0x5b741ef42e838312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f12 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636654.366415:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6800, rc 0) 00000100:00100000:0.0:1788636654.366525:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+12:8729:x1875521207021824:12345-192.168.202.26@tcp:101:mount.lustre.0 Request processed in 294us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636654.366536:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 300 00000100:00100000:2.0:1788636654.370198:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636654.370394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207021952 00000100:00100000:3.0:1788636654.370409:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207021952 00000100:00100000:3.0:1788636654.370485:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 301 00000100:00100000:3.0:1788636654.370499:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+12:8729:x1875521207021952:12345-192.168.202.26@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788636654.370541:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788636654.370581:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788636654.370586:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788636654.370589:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788636654.370592:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788636654.370595:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788636654.373422:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+12:8729:x1875521207021952:12345-192.168.202.26@tcp:256:mount.lustre.0 Request processed in 2909us (3223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636654.373443:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 301 00000100:00100000:2.0:1788636654.376746:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.376899:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207022080 00000100:00100000:0.0:1788636654.376916:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207022080 00000100:00100000:0.0:1788636654.377017:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 302 00000100:00100000:0.0:1788636654.377032:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+12:8729:x1875521207022080:12345-192.168.202.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636654.377061:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636654.377090:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e838319 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f19 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636654.377134:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e838319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f19 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636654.377180:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e838319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f19 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636654.377194:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7a00, rc 0) 00000100:00100000:0.0:1788636654.377288:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:8729:x1875521207022080:12345-192.168.202.26@tcp:101:mount.lustre.0 Request processed in 259us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636654.377297:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 302 00000100:00100000:2.0:1788636654.379697:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.379838:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207022208 00000100:00100000:0.0:1788636654.379851:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207022208 00000100:00100000:0.0:1788636654.379929:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 303 00000100:00100000:0.0:1788636654.379941:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:8729:x1875521207022208:12345-192.168.202.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788636654.380193:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:8729:x1875521207022208:12345-192.168.202.26@tcp:501:mount.lustre.0 Request processed in 252us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636654.380204:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 303 00000100:00100000:1.0:1788636654.382954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636654.383124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207022336 00000100:00100000:2.0:1788636654.383136:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207022336 00000100:00100000:2.0:1788636654.383201:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 304 00000100:00100000:2.0:1788636654.383213:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:8729:x1875521207022336:12345-192.168.202.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788636654.383875:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:8729:x1875521207022336:12345-192.168.202.26@tcp:503:mount.lustre.0 Request processed in 658us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636654.383888:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 304 00000100:00100000:3.0:1788636654.387462:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636654.387730:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207022464 00000100:00100000:1.0:1788636654.387743:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207022464 00000100:00100000:1.0:1788636654.387904:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 305 00000100:00100000:1.0:1788636654.387917:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:8736:x1875521207022464:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788636654.388212:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:8736:x1875521207022464:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 297us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636654.388222:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 305 00000100:00100000:2.0:1788636654.392018:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636654.392185:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207022592 00000100:00100000:3.0:1788636654.392199:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207022592 00000100:00100000:3.0:1788636654.392314:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 306 00000100:00100000:3.0:1788636654.392328:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:8736:x1875521207022592:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636654.392645:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:8736:x1875521207022592:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 318us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636654.392657:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 306 00000100:00100000:0.0:1788636654.411314:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.411391:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.411414:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.411457:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.411512:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207023488 00000100:00100000:0.0:1788636654.411526:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207023488 00000100:00100000:0.0:1788636654.411598:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207023360 00000100:00100000:0.0:1788636654.411600:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207023360 00000100:00100000:0.0:1788636654.411612:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207022720 00000100:00100000:0.0:1788636654.411616:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207022720 00000100:00100000:0.0:1788636654.411624:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207022976 00000100:00100000:0.0:1788636654.411626:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207022976 00000100:00100000:0.0:1788636654.411644:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 144 00000100:00100000:0.0:1788636654.411679:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207023488:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636654.411789:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207023488:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 113us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636654.411799:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 144 00000100:00100000:0.0:1788636654.411846:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 145 00000100:00100000:0.0:1788636654.411853:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2399:x1875521207023360:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636654.411882:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2399:x1875521207023360:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 29us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636654.411890:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 145 00000100:00100000:0.0:1788636654.411902:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:0.0:1788636654.411908:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875521207022720:12345-192.168.202.26@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788636654.411941:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1e9819a8-2c70-4ce1-8555-108bb564fc06@192.168.202.26@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:0.0:1788636654.412005:0:6521:0:(genops.c:1385:class_connect()) connect: client 1e9819a8-2c70-4ce1-8555-108bb564fc06, cookie 0x5b741ef42e838320 00000004:00100000:0.0:1788636654.412043:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788636654.412199:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9cf03a88b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636654.412232:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2397:x1875521207022720:12345-192.168.202.26@tcp:38:mount.lustre.0 Request processed in 322us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636654.412239:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:0.0:1788636654.412265:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:0.0:1788636654.412271:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875521207022976:12345-192.168.202.26@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788636654.412287:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1e9819a8-2c70-4ce1-8555-108bb564fc06@192.168.202.26@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:0.0:1788636654.412313:0:6521:0:(genops.c:1385:class_connect()) connect: client 1e9819a8-2c70-4ce1-8555-108bb564fc06, cookie 0x5b741ef42e838327 00000004:00100000:0.0:1788636654.412327:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788636654.412400:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9cf03a88b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636654.412426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2397:x1875521207022976:12345-192.168.202.26@tcp:38:mount.lustre.0 Request processed in 153us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636654.412432:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:2.0:1788636654.416119:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636654.416164:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636654.416358:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636654.430918:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207022848 00000100:00100000:3.0:1788636654.430945:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207022848 00000100:00100000:3.0:1788636654.431152:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207023104 00000100:00100000:3.0:1788636654.431158:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207023104 00000100:00100000:3.0:1788636654.431179:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207023232 00000100:00100000:3.0:1788636654.431183:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207023232 00000100:00100000:3.0:1788636654.431218:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:3.0:1788636654.431233:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+7:0:x1875521207022848:12345-192.168.202.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788636654.431458:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788636654.431609:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+7:0:x1875521207022848:12345-192.168.202.26@tcp:41:mount.lustre.0 Request processed in 378us (15505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636654.431619:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:3.0:1788636654.431643:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:3.0:1788636654.431652:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:0:x1875521207023104:12345-192.168.202.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788636654.431676:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788636654.431717:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:0:x1875521207023104:12345-192.168.202.26@tcp:41:mount.lustre.0 Request processed in 67us (15551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636654.431723:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:3.0:1788636654.431735:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:3.0:1788636654.431760:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:8729:x1875521207023232:12345-192.168.202.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788636654.431774:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788636654.431796:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:8729:x1875521207023232:12345-192.168.202.26@tcp:41:mount.lustre.0 Request processed in 37us (15439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636654.431802:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00080000:2.0:1788636654.431964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636654.431971:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636654.435793:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636654.435942:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207023616 00000100:00100000:3.0:1788636654.435960:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207023616 00000100:00100000:3.0:1788636654.436045:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:3.0:1788636654.436058:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:8729:x1875521207023616:12345-192.168.202.26@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788636654.436188:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:8729:x1875521207023616:12345-192.168.202.26@tcp:40:mount.lustre.0 Request processed in 131us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636654.436197:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:0.0:1788636654.439211:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.439435:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636654.439479:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636654.440163:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207024000 00000100:00100000:2.0:1788636654.440179:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207024000 00000100:00100000:3.0:1788636654.440430:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207023744 00000100:00100000:3.0:1788636654.440438:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207023744 00000100:00100000:3.0:1788636654.440471:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207023872 00000100:00100000:3.0:1788636654.440474:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207023872 00000100:00100000:3.0:1788636654.440498:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:3.0:1788636654.440510:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875521207023744:12345-192.168.202.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788636654.440562:0:9845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1e9819a8-2c70-4ce1-8555-108bb564fc06@192.168.202.26@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1788636654.440610:0:9845:0:(genops.c:1385:class_connect()) connect: client 1e9819a8-2c70-4ce1-8555-108bb564fc06, cookie 0x5b741ef42e83832e 00002000:00100000:3.0:1788636654.440625:0:9845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1e9819a8-2c70-4ce1-8555-108bb564fc06/ffff9cf03fc88000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788636654.440642:0:9845:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788636654.440764:0:9845:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788636654.440850:0:9845:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc8f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636654.440953:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2397:x1875521207023744:12345-192.168.202.26@tcp:8:mount.lustre.0 Request processed in 443us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636654.440984:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:3.0:1788636654.441007:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:3.0:1788636654.441012:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875521207023872:12345-192.168.202.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788636654.441032:0:9845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1e9819a8-2c70-4ce1-8555-108bb564fc06@192.168.202.26@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1788636654.441052:0:9845:0:(genops.c:1385:class_connect()) connect: client 1e9819a8-2c70-4ce1-8555-108bb564fc06, cookie 0x5b741ef42e838335 00002000:00100000:3.0:1788636654.441058:0:9845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1e9819a8-2c70-4ce1-8555-108bb564fc06/ffff9cf03fc8e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788636654.441074:0:9845:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788636654.441118:0:9845:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788636654.441133:0:9845:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc8a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636654.441158:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2397:x1875521207023872:12345-192.168.202.26@tcp:8:mount.lustre.0 Request processed in 144us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636654.441165:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:2.0:1788636654.441441:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 5 00000100:00100000:2.0:1788636654.441456:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:8729:x1875521207024000:12345-192.168.202.26@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788636654.441512:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:8729:x1875521207024000:12345-192.168.202.26@tcp:900:mount.lustre.0 Request processed in 61us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636654.441520:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 5 00000100:00100000:2.0:1788636654.445222:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636654.445456:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207024128 00000100:00100000:1.0:1788636654.445471:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207024128 00000100:00100000:1.0:1788636654.445585:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 1 00000100:00100000:1.0:1788636654.445598:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:8729:x1875521207024128:12345-192.168.202.26@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788636654.445727:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788636654.445974:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:8729:x1875521207024128:12345-192.168.202.26@tcp:33:mount.lustre.0 Request processed in 377us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636654.445984:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 1 00010000:00010000:0.0:1788636654.998274:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636655.765608:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225975680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636655.765736:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636655.765858:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636655.765865:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225975808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636655.765896:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636655.765961:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225975680 00000100:00100000:1.0:1788636655.765972:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225975680 00000100:00100000:1.0:1788636655.766323:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225975808 00000100:00100000:1.0:1788636655.766343:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225975808 00000100:00100000:1.0:1788636655.766365:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788636655.766374:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225975680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636655.766412:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636655.766883:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225975680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 507us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636655.766892:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788636655.767911:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788636655.767928:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225975808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636655.769080:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636655.769217:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225975808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1278us (3304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636655.769229:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788636655.769578:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225975936:0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.769641:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636655.769685:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225976448:0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.769711:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636655.769734:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225976960:0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.770292:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636655.770442:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788636655.770453:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225976064:0@lo:400:kworker.0 00000100:00080000:1.0:1788636655.770623:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636655.770644:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225976320:0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.770692:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636655.770717:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225976832:0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.770877:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636655.771249:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225976320 00000100:00100000:0.0:1788636655.771264:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225976320 00000100:00100000:0.0:1788636655.771339:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788636655.771351:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225976320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.778831:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636655.778911:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225976576:0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.778964:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636655.779024:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225977088:0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.779052:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636655.779107:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225975936 00000100:00100000:3.0:1788636655.779120:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225975936 00000100:00100000:3.0:1788636655.779199:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788636655.779220:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225975936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.779653:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225975936:12345-0@lo:400:kworker.0 Request processed in 440us (10006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636655.779664:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788636655.779716:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225976448 00000100:00100000:3.0:1788636655.779722:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225976448 00000100:00100000:3.0:1788636655.779770:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788636655.779778:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225976448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.779850:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225976448:12345-0@lo:400:kworker.0 Request processed in 74us (10138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636655.779858:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788636655.779887:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225976960 00000100:00100000:3.0:1788636655.779891:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225976960 00000100:00100000:3.0:1788636655.779942:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225976832 00000100:00100000:3.0:1788636655.779957:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225976832 00000100:00100000:3.0:1788636655.779989:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788636655.779997:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225976960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.780143:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225976960:12345-0@lo:400:kworker.0 Request processed in 147us (9854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636655.780150:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788636655.780165:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788636655.780171:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225976832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.780295:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225976832:12345-0@lo:400:kworker.0 Request processed in 62us (9355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636655.780302:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788636655.780422:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225975936:0@lo:400:kworker.0 00000100:00100000:3.0:1788636655.780440:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225976448:0@lo:400:kworker.0 00010000:00080000:3.0:1788636655.780456:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcac000 x1875521225976960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636655.780576:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225976960:0@lo:400:kworker.0 00010000:00080000:1.0:1788636655.784389:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcac380 x1875521225976832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636655.784424:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225976832:0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.784478:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788636655.784495:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225976192:0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.784615:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636655.784663:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225976704:0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.784703:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636655.784718:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225977216:0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.784740:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636655.784829:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225976064 00000100:00100000:1.0:1788636655.784839:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225976064 00000100:00100000:1.0:1788636655.784901:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225976576 00000100:00100000:1.0:1788636655.784905:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225976576 00000100:00100000:1.0:1788636655.784927:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225977088 00000100:00100000:1.0:1788636655.784930:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225977088 00000100:00100000:1.0:1788636655.784943:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225976704 00000100:00100000:1.0:1788636655.784945:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225976704 00000100:00100000:1.0:1788636655.784959:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225977216 00000100:00100000:1.0:1788636655.784962:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225977216 00000100:00100000:1.0:1788636655.784980:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788636655.784991:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225976064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.785088:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225976064:12345-0@lo:400:kworker.0 Request processed in 97us (6282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636655.785098:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788636655.785119:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788636655.785125:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225976576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.785161:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225976576:12345-0@lo:400:kworker.0 Request processed in 36us (6196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636655.785168:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788636655.785180:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788636655.785186:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225977088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.785229:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225977088:12345-0@lo:400:kworker.0 Request processed in 44us (6177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636655.785247:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788636655.785259:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788636655.785265:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225976704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.785301:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225976704:12345-0@lo:400:kworker.0 Request processed in 36us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636655.785307:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788636655.785319:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788636655.785325:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225977216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.785352:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225977216:12345-0@lo:400:kworker.0 Request processed in 27us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636655.785359:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788636655.785381:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225976192 00000100:00100000:1.0:1788636655.785386:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225976192 00000100:00100000:1.0:1788636655.785417:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788636655.785424:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225976192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.785464:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225976192:12345-0@lo:400:kworker.0 Request processed in 40us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636655.785470:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788636655.785489:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636655.785495:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636655.785499:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636655.785545:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc4e00 x1875521225975808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636655.785571:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225975808:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788636655.785589:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc6d80 x1875521225975680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636655.785612:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225975680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636655.785660:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225976064:0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.785673:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225976576:0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.785686:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225977088:0@lo:400:kworker.0 00000100:00100000:1.0:1788636655.785718:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225976192:0@lo:400:kworker.0 00010000:00080000:1.0:1788636655.785729:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcaf100 x1875521225976704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636655.785738:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225976704:0@lo:400:kworker.0 00010000:00080000:1.0:1788636655.785751:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcad880 x1875521225977216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636655.785761:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225977216:0@lo:400:kworker.0 00000100:00100000:0.0:1788636655.788492:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225976320:12345-0@lo:400:kworker.0 Request processed in 17129us (17785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636655.788512:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788636655.788756:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225976320:0@lo:400:kworker.0 00010000:00010000:0.0:1788636656.022976:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636657.050408:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636658.070319:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636658.325467:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225977344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636658.325558:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636658.325857:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225977472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636658.325904:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636658.325933:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225977344 00000100:00100000:1.0:1788636658.325937:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636658.325943:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225977600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636658.325945:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225977344 00000100:00100000:1.0:1788636658.325965:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636658.325993:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225977600 00000100:00100000:1.0:1788636658.325997:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225977600 00000100:00100000:0.0:1788636658.326019:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788636658.326065:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225977472 00000100:00100000:2.0:1788636658.326069:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225977472 00000100:00100000:2.0:1788636658.326104:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788636658.326113:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225977472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636658.326163:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636658.326218:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225977472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636658.326225:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1788636658.326288:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636658.326365:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225977344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788636658.326385:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636658.326430:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225977344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 402us (873us total) trans 0 rc 0/0 00010000:00080000:3.0:1788636658.326489:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657b80 x1875521225977344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636658.326509:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225977344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636658.328738:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225977472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636658.329108:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788636658.329150:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788636658.329168:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225977600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636658.329194:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636658.329296:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225977600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (3328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636658.329304:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788636658.329348:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcac000 x1875521225977600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636658.329390:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225977600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788636659.093067:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636659.349133:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636659.349160:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225977728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636659.349244:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636659.349619:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225977728 00000100:00100000:3.0:1788636659.349634:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225977728 00000100:00100000:3.0:1788636659.349800:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788636659.349837:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225977728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636659.349894:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788636659.349974:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225977728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636659.350003:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788636659.350033:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225977728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636659.838909:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636659.838977:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636659.839018:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636659.839132:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207024256 00000100:00100000:1.0:1788636659.839151:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207024256 00000100:00100000:0.0:1788636659.839358:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207024512 00000100:00100000:0.0:1788636659.839365:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207024512 00000100:00100000:0.0:1788636659.839438:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207024768 00000100:00100000:0.0:1788636659.839441:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207024768 00000100:00100000:0.0:1788636659.839475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 152 00000100:00100000:0.0:1788636659.839486:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207024512:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636659.839586:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207024512:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 102us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636659.839595:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 152 00000100:00100000:0.0:1788636659.839616:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 153 00000100:00100000:0.0:1788636659.839623:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207024768:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636659.839649:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207024768:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 26us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636659.839655:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 153 00000100:00080000:0.0:1788636659.839673:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636659.839870:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 308 00000100:00100000:1.0:1788636659.839880:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207024256:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636659.839910:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207024256:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 33us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636659.839916:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 308 00000100:00100000:2.0:1788636659.844771:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636659.844850:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636659.844874:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636659.844880:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207025024 00000100:00100000:1.0:1788636659.844891:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207025024 00000100:00100000:2.0:1788636659.844897:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636659.844919:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207024896 00000100:00100000:2.0:1788636659.844923:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207024896 00000100:00100000:1.0:1788636659.844964:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:1.0:1788636659.844975:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207025024:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636659.845047:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207025024:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636659.845056:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:1.0:1788636659.845086:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:1.0:1788636659.845099:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207024896:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636659.845143:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207024896:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 49us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636659.845150:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00080000:0.0:1788636659.845454:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636659.845463:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636659.845506:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207024384 00000100:00100000:0.0:1788636659.845515:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207024384 00000100:00100000:0.0:1788636659.845573:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207024640 00000100:00100000:0.0:1788636659.845576:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207024640 00000100:00100000:0.0:1788636659.846200:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 154 00000100:00100000:0.0:1788636659.846215:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207024384:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636659.846964:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207024384:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 680us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636659.846977:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 154 00000100:00100000:0.0:1788636659.847008:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 155 00000100:00100000:0.0:1788636659.847018:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207024640:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636659.847052:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207024640:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 37us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636659.847058:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 155 00000100:00080000:0.0:1788636659.847158:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636660.118502:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788636660.380826:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1e9819a8-2c70-4ce1-8555-108bb564fc06 00000001:00100000:0.0:1788636660.389709:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1e9819a8-2c70-4ce1-8555-108bb564fc06 00000001:00100000:0.0:1788636660.390527:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1e9819a8-2c70-4ce1-8555-108bb564fc06 00000001:00100000:3.0:1788636660.390710:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1e9819a8-2c70-4ce1-8555-108bb564fc06 00000001:02000400:1.0:1788636660.730668:0:12192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1788636660.887285:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225977856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636660.887378:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636660.887954:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225977856 00000100:00100000:1.0:1788636660.887963:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225977856 00000100:00100000:1.0:1788636660.888025:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788636660.888050:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225977856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636660.888092:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636660.888893:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225977856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 840us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636660.888903:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788636660.888937:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225977984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636660.888973:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788636660.889017:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636660.889028:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225977984 00000100:00100000:1.0:1788636660.889033:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225977984 00000100:00100000:1.0:1788636660.889062:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788636660.889069:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225977984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636660.889083:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636660.889493:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225977984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 422us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636660.889499:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788636660.889517:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788636660.889549:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03655f80 x1875521225977856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636660.889571:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225977856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636660.890009:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225978112:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890051:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890079:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225978624:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890274:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890294:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225979136:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890321:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890341:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788636660.890347:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225978496:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890371:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225979008:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890407:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890429:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225978240:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890452:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890469:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225978752:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890487:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890503:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521225979264:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890523:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890540:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788636660.890546:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225978368:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890566:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890583:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225978880:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890616:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890625:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225979392:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.890640:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636660.890658:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225978624 00000100:00100000:3.0:1788636660.890664:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225978624 00000100:00100000:3.0:1788636660.890692:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225978368 00000100:00100000:3.0:1788636660.890695:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225978368 00000100:00100000:3.0:1788636660.890707:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788636660.890829:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225979136 00000100:00100000:1.0:1788636660.890834:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225979136 00000100:00100000:1.0:1788636660.890868:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225979008 00000100:00100000:1.0:1788636660.890871:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225979008 00000100:00100000:1.0:1788636660.890894:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788636660.890902:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225979136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636660.890965:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225979136:12345-0@lo:400:kworker.0 Request processed in 64us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636660.890972:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788636660.890986:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788636660.890993:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225979008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636660.891020:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225979008:12345-0@lo:400:kworker.0 Request processed in 28us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636660.891026:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788636660.891047:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636660.891074:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcaf800 x1875521225979008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636660.891086:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225979008:0@lo:400:kworker.0 00010000:00080000:1.0:1788636660.891095:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcae680 x1875521225979136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636660.891118:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225979136:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.893575:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225978624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.893683:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225978624:12345-0@lo:400:kworker.0 Request processed in 124us (3408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636660.893692:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788636660.893777:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788636660.893786:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225978368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.893850:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225978368:12345-0@lo:400:kworker.0 Request processed in 65us (3283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636660.893857:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788636660.893900:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225978368:0@lo:400:kworker.0 00000100:00100000:1.0:1788636660.897362:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225978624:0@lo:400:kworker.0 00010000:00080000:0.0:1788636660.898383:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc4380 x1875521225977984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636660.898404:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225977984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636660.898441:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225978112 00000100:00100000:0.0:1788636660.898448:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225978112 00000100:00100000:0.0:1788636660.898494:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788636660.898503:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521225978112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636660.898587:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521225978112:12345-0@lo:400:kworker.0 Request processed in 85us (8536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636660.898606:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788636660.898644:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225978496 00000100:00100000:0.0:1788636660.898649:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225978496 00000100:00100000:0.0:1788636660.898668:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225978240 00000100:00100000:0.0:1788636660.898671:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225978240 00000100:00100000:0.0:1788636660.898681:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225978752 00000100:00100000:0.0:1788636660.898683:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225978752 00000100:00100000:0.0:1788636660.898705:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225979264 00000100:00100000:0.0:1788636660.898708:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225979264 00000100:00100000:0.0:1788636660.900898:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225978880 00000100:00100000:0.0:1788636660.900913:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225978880 00000100:00100000:0.0:1788636660.900932:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225979392 00000100:00100000:0.0:1788636660.900935:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225979392 00000100:00100000:0.0:1788636660.900955:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788636660.900964:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225978496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636660.901055:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225978496:12345-0@lo:400:kworker.0 Request processed in 91us (10682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636660.901063:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788636660.901079:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788636660.901084:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225978240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636660.901878:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225978240:12345-0@lo:400:kworker.0 Request processed in 788us (11419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636660.901888:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788636660.901913:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788636660.901922:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225978752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636660.901966:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225978752:12345-0@lo:400:kworker.0 Request processed in 46us (11478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636660.901972:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788636660.901994:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788636660.902001:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521225979264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636660.902030:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521225979264:12345-0@lo:400:kworker.0 Request processed in 30us (11507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636660.902037:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788636660.902047:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788636660.902054:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225978880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636660.902078:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225978880:12345-0@lo:400:kworker.0 Request processed in 26us (11462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636660.902084:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788636660.902092:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00010000:00080000:3.0:1788636660.902280:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcad500 x1875521225978880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636660.902300:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225978880:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.902315:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225978240:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.902328:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225978752:0@lo:400:kworker.0 00000100:00100000:3.0:1788636660.902342:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521225979264:0@lo:400:kworker.0 00000100:00100000:0.0:1788636660.903296:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225979392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636660.903388:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225979392:12345-0@lo:400:kworker.0 Request processed in 1287us (12744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636660.903396:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788636660.904313:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636660.904319:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636660.904358:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225978496:0@lo:400:kworker.0 00000100:00100000:0.0:1788636660.904372:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225978112:0@lo:400:kworker.0 00010000:00080000:3.0:1788636660.906169:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcac380 x1875521225979392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636660.906185:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225979392:0@lo:400:kworker.0 00010000:00010000:2.0:1788636661.141058:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636662.167663:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636663.190364:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636663.450713:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225979520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636663.450795:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636663.450894:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225979520 00000100:00100000:0.0:1788636663.450903:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225979520 00000100:00100000:0.0:1788636663.450951:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788636663.450971:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225979520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636663.451008:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636663.451056:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225979520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636663.451063:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788636663.451126:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225979520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636663.461504:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225979648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636663.461598:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636663.461793:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225979776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636663.461842:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636663.461882:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225979648 00000100:00100000:0.0:1788636663.461889:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225979648 00000100:00100000:0.0:1788636663.461932:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225979776 00000100:00100000:0.0:1788636663.461935:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225979776 00000100:00100000:0.0:1788636663.461953:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636663.461961:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225979648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636663.461992:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636663.462035:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225979648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636663.462042:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636663.462058:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788636663.462065:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225979776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788636663.464856:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636663.464971:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225979776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2902us (3124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636663.464995:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788636663.465036:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636663.465221:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03654e00 x1875521225979776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636663.465251:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225979776:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788636663.465432:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fccd180 x1875521225979648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636663.465459:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225979648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788636664.216635:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636664.477098:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636664.477131:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225979904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636664.477239:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636664.477335:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225979904 00000100:00100000:1.0:1788636664.477345:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225979904 00000100:00100000:1.0:1788636664.477420:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788636664.477432:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225979904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636664.477486:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788636664.477906:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225979904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 474us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636664.477915:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788636664.478086:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225979904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636664.994582:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636664.994763:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636664.994790:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636664.994856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636664.994880:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636664.994908:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636664.994954:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207025792 00000100:00100000:1.0:1788636664.994971:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207025792 00000100:00100000:1.0:1788636664.995081:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:1.0:1788636664.995096:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207025792:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636664.995283:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207025792:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 190us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636664.995293:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:1.0:1788636664.996588:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636664.996628:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207025920 00000100:00100000:1.0:1788636664.996641:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207025920 00000100:00100000:1.0:1788636664.996698:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 68 00000100:00100000:1.0:1788636664.996708:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207025920:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636664.996778:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207025920:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636664.996786:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 68 00000100:00100000:0.0:1788636664.997262:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207025152 00000100:00100000:0.0:1788636664.997271:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207025152 00000100:00100000:0.0:1788636664.997325:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 310 00000100:00100000:0.0:1788636664.997534:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207025152:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636664.997580:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207025152:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 248us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636664.997587:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 310 00000100:00100000:0.0:1788636664.997642:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207025280 00000100:00100000:0.0:1788636664.997647:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207025280 00000100:00100000:0.0:1788636664.997672:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207025408 00000100:00100000:0.0:1788636664.997675:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207025408 00000100:00100000:0.0:1788636664.997688:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207025536 00000100:00100000:0.0:1788636664.997691:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207025536 00000100:00100000:0.0:1788636664.997703:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207025664 00000100:00100000:0.0:1788636664.997705:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207025664 00000100:00100000:0.0:1788636664.997720:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 162 00000100:00100000:0.0:1788636664.997727:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207025280:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636664.997763:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207025280:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 33us (2998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636664.997769:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 162 00000100:00100000:0.0:1788636664.997795:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 163 00000100:00100000:0.0:1788636664.997802:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207025408:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636664.998251:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 164 00000100:00100000:1.0:1788636664.998261:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207025536:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636664.998322:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207025536:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 63us (3464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636664.998329:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 164 00000100:00100000:1.0:1788636664.998414:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 165 00000100:00100000:1.0:1788636664.998421:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207025664:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636664.998449:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207025664:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 28us (3569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636664.998455:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 165 00000100:00100000:0.0:1788636664.998652:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207025408:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 850us (3860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636664.998659:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 163 00000100:00080000:0.0:1788636664.998680:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636664.998686:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636664.998689:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636664.998692:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788636665.237327:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636666.005303:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225980160:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005373:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005421:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225980672:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005440:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005460:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225981184:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005479:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005508:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788636666.005513:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225980032:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005540:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005561:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225980544:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005585:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005602:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225981056:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005624:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005643:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225981568:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005661:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005688:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225980288:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005712:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005730:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225980800:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005750:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005766:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225981312:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005856:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005873:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788636666.005879:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225980416:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005899:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005908:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225980928:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005928:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005946:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225981440:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.005964:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636666.005992:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225980160 00000100:00100000:2.0:1788636666.006000:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225980160 00000100:00100000:1.0:1788636666.006231:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636666.006241:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225981696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636666.006271:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636666.006295:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225981056 00000100:00100000:1.0:1788636666.006299:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225981696 00000100:00100000:3.0:1788636666.006300:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225981056 00000100:00100000:1.0:1788636666.006301:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225981696 00000100:00100000:2.0:1788636666.006357:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225980672 00000100:00100000:2.0:1788636666.006360:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225980672 00000100:00100000:1.0:1788636666.006360:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788636666.006369:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225981696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636666.006400:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636666.006446:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225981696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636666.006453:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788636666.009955:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcad880 x1875521225981696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636666.009986:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225981696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636666.010156:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636666.010176:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225981824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636666.010245:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636666.010294:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225981568 00000100:00100000:3.0:1788636666.010302:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225981568 00000100:00100000:3.0:1788636666.010347:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225980928 00000100:00100000:3.0:1788636666.010351:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225980928 00000100:00100000:3.0:1788636666.010370:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225981440 00000100:00100000:3.0:1788636666.010372:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225981440 00000100:00100000:3.0:1788636666.010391:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788636666.010402:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225981568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636666.010454:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225981568:12345-0@lo:400:kworker.0 Request processed in 53us (4790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636666.010460:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788636666.010478:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788636666.010484:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225980928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636666.010514:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225980928:12345-0@lo:400:kworker.0 Request processed in 30us (4585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636666.010520:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788636666.010531:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788636666.010537:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225981440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636666.010583:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225981440:12345-0@lo:400:kworker.0 Request processed in 47us (4618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636666.010590:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788636666.010610:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225980544 00000100:00100000:3.0:1788636666.010614:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225980544 00000100:00100000:3.0:1788636666.010638:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225980288 00000100:00100000:3.0:1788636666.010642:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225980288 00000100:00100000:3.0:1788636666.010655:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788636666.010662:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225980544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636666.010697:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225980544:12345-0@lo:400:kworker.0 Request processed in 36us (5111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636666.010703:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788636666.010714:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788636666.010720:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225980288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636666.010748:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032404700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225980288:12345-0@lo:400:kworker.0 Request processed in 29us (5036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636666.010754:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788636666.010770:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225980032 00000100:00100000:3.0:1788636666.010774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225980032 00000100:00100000:3.0:1788636666.010801:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788636666.010827:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521225980032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636666.010858:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521225980032:12345-0@lo:400:kworker.0 Request processed in 51us (5317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636666.010863:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788636666.010889:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225981184 00000100:00100000:3.0:1788636666.010892:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225981184 00000100:00100000:3.0:1788636666.010908:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225980800 00000100:00100000:3.0:1788636666.010916:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225980800 00000100:00100000:3.0:1788636666.010931:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225981312 00000100:00100000:3.0:1788636666.010933:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225981312 00000100:00100000:3.0:1788636666.010944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225980416 00000100:00100000:3.0:1788636666.010946:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225980416 00000100:00100000:3.0:1788636666.010958:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788636666.010964:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225980160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636666.010994:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032404a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225980160:12345-0@lo:400:kworker.0 Request processed in 30us (5621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636666.011000:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788636666.011156:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225981824 00000100:00100000:0.0:1788636666.011161:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225981824 00000100:00100000:0.0:1788636666.011189:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788636666.011197:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225981824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636666.011213:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636666.011261:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225981824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636666.011266:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1788636666.011312:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657b80 x1875521225981824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636666.011329:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225981824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636666.011834:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788636666.011844:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225981184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636666.011888:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032405f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225981184:12345-0@lo:400:kworker.0 Request processed in 46us (6407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636666.011894:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788636666.011908:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788636666.011914:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225980800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636666.011944:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225980800:12345-0@lo:400:kworker.0 Request processed in 30us (6193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636666.011950:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788636666.011961:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788636666.011967:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225981312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636666.011994:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032407100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225981312:12345-0@lo:400:kworker.0 Request processed in 28us (6190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636666.012000:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788636666.012146:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788636666.012153:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225980416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636666.012186:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032405180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225980416:12345-0@lo:400:kworker.0 Request processed in 34us (6286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636666.012193:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788636666.012233:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225980032:0@lo:400:kworker.0 00000100:00100000:0.0:1788636666.012247:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225980544:0@lo:400:kworker.0 00010000:00080000:0.0:1788636666.012263:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf032406300 x1875521225981568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636666.012274:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225981568:0@lo:400:kworker.0 00000100:00100000:0.0:1788636666.012302:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225980160:0@lo:400:kworker.0 00000100:00100000:0.0:1788636666.012313:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225981184:0@lo:400:kworker.0 00000100:00100000:0.0:1788636666.012395:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225980416:0@lo:400:kworker.0 00010000:00080000:0.0:1788636666.012408:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03244380 x1875521225980928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636666.012418:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225980928:0@lo:400:kworker.0 00010000:00080000:0.0:1788636666.012429:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03245880 x1875521225981440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636666.012437:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225981440:0@lo:400:kworker.0 00000100:00100000:0.0:1788636666.012449:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225980288:0@lo:400:kworker.0 00010000:00080000:0.0:1788636666.012458:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03244a80 x1875521225980800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636666.012466:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225980800:0@lo:400:kworker.0 00010000:00080000:0.0:1788636666.012477:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03246a00 x1875521225981312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636666.012485:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225981312:0@lo:400:kworker.0 00000100:00100000:3.0:1788636666.023786:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788636666.023819:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225981056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636666.023948:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225981056:12345-0@lo:400:kworker.0 Request processed in 151us (18322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636666.023956:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1788636666.024005:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03244e00 x1875521225981056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636666.024019:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225981056:0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.024184:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788636666.024192:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225980672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636666.024235:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225980672:12345-0@lo:400:kworker.0 Request processed in 45us (18794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636666.024241:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788636666.024267:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225980672:0@lo:400:kworker.0 00000100:00080000:1.0:1788636666.034957:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636666.035318:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636666.035323:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636666.035327:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788636666.261026:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636667.285959:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636668.309958:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636668.567403:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636668.567449:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225981952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636668.567523:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636668.567613:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225981952 00000100:00100000:0.0:1788636668.567623:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225981952 00000100:00100000:1.0:1788636668.567686:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225982080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636668.567709:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788636668.567724:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225981952:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636668.567729:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788636668.567763:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636668.567779:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788636668.567788:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788636668.567853:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225981952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636668.567861:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1788636668.567869:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657b80 x1875521225981952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636668.567878:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225982080 00000100:00100000:0.0:1788636668.567884:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225982080 00000100:00100000:1.0:1788636668.567903:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225981952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636668.567911:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788636668.567918:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225982080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636668.567928:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636668.567969:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225982080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (243us total) trans 0 rc 0/0 00000100:00080000:3.0:1788636668.567976:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636668.567977:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788636668.568125:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fccf480 x1875521225982080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636668.568141:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225982080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636668.568288:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225982208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636668.568328:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636668.568715:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225982208 00000100:00100000:3.0:1788636668.568720:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225982208 00000100:00100000:3.0:1788636668.568765:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788636668.568774:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225982208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788636668.568803:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788636668.568890:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225982208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636668.568897:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788636668.569062:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225982208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788636669.333129:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788636669.514457:0:12511:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788636669.514613:0:12511:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788636669.590144:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636669.590174:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225982336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636669.590278:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636669.590468:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225982336 00000100:00100000:0.0:1788636669.590477:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225982336 00000100:00100000:0.0:1788636669.590545:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788636669.590556:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225982336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636669.590600:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788636669.590653:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225982336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636669.590660:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788636669.590961:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225982336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636670.081978:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636670.082024:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636670.082045:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636670.082079:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636670.082261:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207026176 00000100:00100000:3.0:1788636670.082271:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207026176 00000100:00100000:3.0:1788636670.082334:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207026432 00000100:00100000:3.0:1788636670.082337:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207026432 00000100:00100000:3.0:1788636670.082359:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 172 00000100:00100000:3.0:1788636670.082369:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207026176:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636670.082443:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207026176:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 74us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636670.082450:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 172 00000100:00100000:3.0:1788636670.082470:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 173 00000100:00100000:3.0:1788636670.082476:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207026432:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636670.082515:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207026432:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 39us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636670.082522:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 173 00000100:00080000:3.0:1788636670.082541:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636670.082907:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207026688 00000100:00100000:0.0:1788636670.082912:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207026688 00000100:00100000:0.0:1788636670.082951:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 73 00000100:00100000:0.0:1788636670.082959:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207026688:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636670.083008:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207026688:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 40us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636670.083015:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 73 00000100:00100000:0.0:1788636670.083036:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207026048 00000100:00100000:0.0:1788636670.083040:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207026048 00000100:00100000:0.0:1788636670.083064:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 312 00000100:00100000:0.0:1788636670.083070:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207026048:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636670.083096:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207026048:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 26us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636670.083115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 312 00000100:00100000:1.0:1788636670.083265:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636670.083337:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636670.083367:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636670.083654:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207026816 00000100:00100000:0.0:1788636670.083658:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207026816 00000100:00100000:0.0:1788636670.083686:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 74 00000100:00100000:0.0:1788636670.083693:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207026816:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636670.083725:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207026816:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636670.083731:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 74 00000100:00080000:3.0:1788636670.084481:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636670.084498:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636670.084515:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207026304 00000100:00100000:3.0:1788636670.084520:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207026304 00000100:00100000:3.0:1788636670.084606:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207026560 00000100:00100000:3.0:1788636670.084610:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207026560 00000100:00100000:3.0:1788636670.084630:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 174 00000100:00100000:3.0:1788636670.084638:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207026304:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636670.084694:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207026304:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 57us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636670.084700:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 174 00000100:00100000:3.0:1788636670.084716:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 175 00000100:00100000:3.0:1788636670.084737:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207026560:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636670.084762:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207026560:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 26us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636670.084768:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 175 00000100:00080000:3.0:1788636670.086445:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788636670.357012:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636671.125103:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636671.125145:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225982464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636671.125225:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636671.125283:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225982720:0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.125315:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636671.125335:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225982976:0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.125358:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225983232:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.125373:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636671.125661:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225983488:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.125687:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636671.125706:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225984000:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.125738:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636671.125762:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788636671.125768:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225982848:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.125803:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636671.125843:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225983360:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.125864:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636671.126008:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225982464 00000100:00100000:0.0:1788636671.126017:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225982464 00000100:00100000:0.0:1788636671.126079:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788636671.126090:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225982464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636671.126135:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636671.126183:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225982464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636671.126190:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788636671.126223:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636671.126843:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225983872:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.126872:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788636671.126938:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657b80 x1875521225982464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636671.126957:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225982464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636671.128514:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225982720 00000100:00100000:3.0:1788636671.128526:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225982720 00000100:00100000:3.0:1788636671.128565:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225982976 00000100:00100000:3.0:1788636671.128568:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225982976 00000100:00100000:3.0:1788636671.128579:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225983360 00000100:00100000:3.0:1788636671.128581:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225983360 00000100:00100000:1.0:1788636671.128591:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225983488 00000100:00100000:1.0:1788636671.128594:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225983488 00000100:00100000:3.0:1788636671.128602:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225983872 00000100:00100000:3.0:1788636671.128605:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225983872 00000100:00100000:1.0:1788636671.128618:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225984000 00000100:00100000:3.0:1788636671.128620:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788636671.128620:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225984000 00000100:00100000:3.0:1788636671.128628:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225982720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.128638:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636671.128644:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225983488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636671.128698:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788636671.128706:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225982976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.129058:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225982720:12345-0@lo:400:kworker.0 Request processed in 429us (3741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636671.129058:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225983488:12345-0@lo:400:kworker.0 Request processed in 413us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636671.129067:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788636671.129067:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788636671.129084:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788636671.129084:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788636671.129090:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225984000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.129185:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225983360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.129294:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225984000:12345-0@lo:400:kworker.0 Request processed in 203us (3555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636671.129301:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788636671.129303:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225983360:12345-0@lo:400:kworker.0 Request processed in 213us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636671.129309:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788636671.129322:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225982848 00000100:00100000:1.0:1788636671.129326:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225982848 00000100:00100000:3.0:1788636671.129328:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788636671.129334:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225983872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.129363:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225983872:12345-0@lo:400:kworker.0 Request processed in 29us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636671.129368:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:3.0:1788636671.129389:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636671.129393:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636671.129426:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788636671.129434:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225982848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.129466:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225982848:12345-0@lo:400:kworker.0 Request processed in 34us (3663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636671.129523:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788636671.129609:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225982848:0@lo:400:kworker.0 00010000:00080000:1.0:1788636671.129625:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fccd180 x1875521225983360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636671.129635:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225983360:0@lo:400:kworker.0 00010000:00080000:1.0:1788636671.129645:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0360a680 x1875521225983872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636671.129652:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225983872:0@lo:400:kworker.0 00010000:00080000:1.0:1788636671.129663:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03609500 x1875521225983488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636671.129671:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03609500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225983488:0@lo:400:kworker.0 00010000:00080000:1.0:1788636671.129681:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0360b100 x1875521225984000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636671.129687:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225984000:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.129860:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225982592:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.129904:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636671.129936:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225982592 00000100:00100000:1.0:1788636671.129937:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225983104:0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.129940:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225982592 00000100:00100000:1.0:1788636671.129961:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636671.129969:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788636671.129974:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225982592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.129978:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225983616:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.130012:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636671.130016:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225982592:12345-0@lo:400:kworker.0 Request processed in 42us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636671.130023:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788636671.130031:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225984128:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.130050:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636671.130088:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225982592:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.130105:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636671.130433:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225982976:12345-0@lo:400:kworker.0 Request processed in 1726us (5056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636671.130436:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225983616 00000100:00100000:3.0:1788636671.130440:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225983616 00000100:00100000:0.0:1788636671.130442:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788636671.130470:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225984128 00000100:00100000:3.0:1788636671.130472:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225984128 00000100:00100000:3.0:1788636671.130492:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788636671.130498:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225983616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.130531:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225983616:12345-0@lo:400:kworker.0 Request processed in 33us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636671.130537:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788636671.130549:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788636671.130555:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225984128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.130574:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225984256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636671.130584:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225984128:12345-0@lo:400:kworker.0 Request processed in 30us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636671.130597:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636671.130598:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788636671.130615:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636671.130619:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636671.130661:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225982976:0@lo:400:kworker.0 00010000:00080000:1.0:1788636671.130661:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03609f80 x1875521225983616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636671.130671:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03609f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225983616:0@lo:400:kworker.0 00010000:00080000:1.0:1788636671.130679:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03608380 x1875521225984128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636671.130686:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03608380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225984128:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.130705:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225983104 00000100:00100000:1.0:1788636671.130708:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225983104 00000100:00100000:1.0:1788636671.130749:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788636671.130757:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225983104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.130794:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225983104:12345-0@lo:400:kworker.0 Request processed in 37us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636671.130799:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788636671.131004:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225983104:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.131220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636671.131262:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225983232 00000100:00100000:3.0:1788636671.131267:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225983232 00000100:00100000:1.0:1788636671.131313:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225983744:0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.131335:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788636671.131339:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636671.131343:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225983232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.131376:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225983232:12345-0@lo:400:kworker.0 Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636671.131382:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788636671.131393:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225983744 00000100:00100000:3.0:1788636671.131396:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225983744 00000100:00080000:2.0:1788636671.131419:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636671.131444:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225982720:0@lo:400:kworker.0 00000100:00100000:1.0:1788636671.131456:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225983232:0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.131493:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788636671.131499:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225983744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636671.131555:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225983744:12345-0@lo:400:kworker.0 Request processed in 56us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636671.131561:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788636671.131578:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225984256 00000100:00100000:0.0:1788636671.131583:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225984256 00000100:00100000:0.0:1788636671.131617:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788636671.131625:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225984256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636671.131640:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636671.131674:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225984256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636671.131680:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788636671.131697:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0320c380 x1875521225984256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636687 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636671.131713:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225984256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636671.131793:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225983744:0@lo:400:kworker.0 00010000:00010000:0.0:1788636671.381306:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788636671.538524:0:12608:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788636671.538779:0:12608:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788636672.405104:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636673.435084:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636673.688045:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225984384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636673.688161:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636673.688992:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225984512:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636673.689050:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636673.689113:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225984512 00000100:00100000:2.0:1788636673.689122:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225984512 00000100:00100000:2.0:1788636673.689176:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788636673.689187:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225984512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636673.689228:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636673.689279:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225984512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636673.689287:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788636673.689347:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225984512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636673.691903:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225984640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636673.691992:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636673.692071:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225984384 00000100:00100000:1.0:1788636673.692082:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225984384 00000100:00100000:1.0:1788636673.692139:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225984640 00000100:00100000:1.0:1788636673.692143:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225984640 00000100:00100000:1.0:1788636673.692163:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788636673.692172:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225984384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636673.692209:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636673.692258:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225984384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (4096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636673.692265:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788636673.692281:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788636673.692289:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225984640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636673.692298:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636673.692325:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225984640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636673.692331:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788636673.692346:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636673.692381:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fccf480 x1875521225984640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636673.692402:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225984640:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788636673.692437:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0360b800 x1875521225984384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636673.692469:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225984384:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1788636673.854223:0:12707:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636673.854520:0:12707:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788636674.453080:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636674.713795:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636674.713890:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225984768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636674.714022:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636674.714226:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225984768 00000100:00100000:2.0:1788636674.714236:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225984768 00000100:00100000:2.0:1788636674.714303:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788636674.714315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225984768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788636674.714363:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788636674.714429:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225984768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636674.714459:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788636674.714521:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225984768:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636675.204456:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636675.204523:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636675.204568:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636675.204618:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636675.204640:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636675.204660:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636675.204699:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636675.204740:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207027584 00000100:00100000:3.0:1788636675.204755:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207027584 00000100:00100000:3.0:1788636675.204856:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207027712 00000100:00100000:3.0:1788636675.204860:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207027712 00000100:00100000:3.0:1788636675.204889:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:3.0:1788636675.204902:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2397:x1875521207027584:12345-192.168.202.26@tcp:9:kworker.0 00000020:00000080:3.0:1788636675.204963:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e83832e 00000100:00080000:3.0:1788636675.204977:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc8f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788636675.205049:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788636675.205286:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+2:2397:x1875521207027584:12345-192.168.202.26@tcp:9:kworker.0 Request processed in 386us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636675.205295:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:3.0:1788636675.205316:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:3.0:1788636675.205324:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2397:x1875521207027712:12345-192.168.202.26@tcp:9:kworker.0 00000020:00000080:3.0:1788636675.205337:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838335 00000100:00080000:3.0:1788636675.205344:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc8a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788636675.205367:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788636675.205448:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+2:2397:x1875521207027712:12345-192.168.202.26@tcp:9:kworker.0 Request processed in 124us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636675.205456:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:3.0:1788636675.205479:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207026944 00000100:00100000:3.0:1788636675.205483:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207026944 00000100:00100000:3.0:1788636675.205512:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 314 00000100:00100000:3.0:1788636675.205528:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207026944:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636675.205558:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207026944:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 32us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636675.205565:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 314 00000100:00100000:3.0:1788636675.205603:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207027072 00000100:00100000:3.0:1788636675.205607:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207027072 00000100:00100000:3.0:1788636675.205632:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207027328 00000100:00100000:3.0:1788636675.205635:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207027328 00000100:00100000:3.0:1788636675.205648:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207027200 00000100:00100000:3.0:1788636675.205652:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207027200 00000100:00100000:3.0:1788636675.205667:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207027456 00000100:00100000:3.0:1788636675.205669:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207027456 00000100:00100000:3.0:1788636675.205686:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 182 00000100:00100000:3.0:1788636675.205694:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2399:x1875521207027072:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636675.205726:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2399:x1875521207027072:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 33us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636675.205733:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 182 00000100:00100000:3.0:1788636675.205746:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 183 00000100:00100000:3.0:1788636675.205752:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207027328:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636675.205779:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207027328:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 27us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636675.205785:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 183 00000100:00100000:3.0:1788636675.205796:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 184 00000100:00100000:3.0:1788636675.205803:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207027200:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636675.205865:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207027200:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 63us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636675.205880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 184 00000100:00100000:3.0:1788636675.205894:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 185 00000100:00100000:3.0:1788636675.205902:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207027456:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636675.205934:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03608a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207027456:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 33us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636675.205941:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 185 00000100:00080000:3.0:1788636675.205988:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636675.205993:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636675.205996:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636675.205998:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788636675.206531:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636675.206539:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636675.480349:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636676.246024:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225985024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636676.246152:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636676.246238:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636676.246246:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225984896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636676.246272:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636676.246566:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225985024 00000100:00100000:1.0:1788636676.246580:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225985024 00000100:00100000:1.0:1788636676.246654:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225984896 00000100:00100000:1.0:1788636676.246657:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225984896 00000100:00100000:1.0:1788636676.246682:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788636676.246694:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225985024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636676.246734:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636676.246830:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225985024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636676.246839:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788636676.246858:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788636676.246864:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225984896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636676.246874:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636676.246898:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03608e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225984896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636676.246904:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788636676.247281:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657b80 x1875521225984896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636676.247592:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225985408:0@lo:400:kworker.0 00000100:00100000:2.0:1788636676.247643:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636676.247669:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225985920:0@lo:400:kworker.0 00000100:00100000:2.0:1788636676.247695:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636676.247716:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225986432:0@lo:400:kworker.0 00000100:00100000:2.0:1788636676.247739:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636676.247779:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788636676.247786:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225985536:0@lo:400:kworker.0 00000100:00100000:2.0:1788636676.247832:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636676.247853:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225986048:0@lo:400:kworker.0 00000100:00100000:2.0:1788636676.247878:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636676.247912:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225985408 00000100:00100000:2.0:1788636676.247918:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225985408 00000100:00100000:2.0:1788636676.247970:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788636676.247980:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225985408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636676.248033:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225985408:12345-0@lo:400:kworker.0 Request processed in 54us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636676.248053:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788636676.248317:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225984896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636676.248381:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225985408:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.250335:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225985152:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.250439:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636676.250523:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225985664:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.250561:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636676.250592:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225986176:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.250619:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636676.250655:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788636676.250663:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225985280:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.250691:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636676.250729:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225985792:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.250758:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636676.250771:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225986304:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.250785:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636676.250841:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225986048 00000100:00100000:1.0:1788636676.250849:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225986048 00000100:00100000:1.0:1788636676.250904:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225986176 00000100:00100000:1.0:1788636676.250905:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225986176 00000100:00100000:1.0:1788636676.250923:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788636676.250930:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225986048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.251018:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225986048:12345-0@lo:400:kworker.0 Request processed in 87us (3138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636676.251026:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788636676.251515:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225985152 00000100:00100000:2.0:1788636676.251530:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225985152 00000100:00100000:2.0:1788636676.251580:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788636676.251588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225985152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636676.251639:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225985152:12345-0@lo:400:kworker.0 Request processed in 53us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636676.251645:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788636676.251721:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788636676.251732:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225986176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.251896:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225986176:12345-0@lo:400:kworker.0 Request processed in 166us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636676.251903:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788636676.251924:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225985664 00000100:00100000:1.0:1788636676.251928:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225985664 00000100:00100000:1.0:1788636676.251964:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788636676.251970:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225985664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.252007:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225985664:12345-0@lo:400:kworker.0 Request processed in 37us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636676.252013:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788636676.252264:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225985920 00000100:00100000:1.0:1788636676.252270:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225985920 00000100:00100000:1.0:1788636676.252383:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225986432 00000100:00100000:1.0:1788636676.252387:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225986432 00000100:00100000:1.0:1788636676.252404:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225985536 00000100:00100000:1.0:1788636676.252407:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225985536 00000100:00100000:1.0:1788636676.252420:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225985280 00000100:00100000:1.0:1788636676.252424:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225985280 00000100:00100000:1.0:1788636676.252435:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225985792 00000100:00100000:1.0:1788636676.252438:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225985792 00000100:00100000:1.0:1788636676.252448:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225986304 00000100:00100000:1.0:1788636676.252451:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225986304 00000100:00100000:1.0:1788636676.252546:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788636676.252554:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225985920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.252605:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225985920:12345-0@lo:400:kworker.0 Request processed in 52us (4909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636676.252613:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788636676.252628:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788636676.252635:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225986432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.252668:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225986432:12345-0@lo:400:kworker.0 Request processed in 33us (4927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636676.252675:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788636676.252686:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788636676.252691:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225985536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.252720:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225985536:12345-0@lo:400:kworker.0 Request processed in 30us (4888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636676.252727:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788636676.252738:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788636676.252745:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225985280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.252973:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225985280:12345-0@lo:400:kworker.0 Request processed in 227us (2279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636676.252989:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788636676.253002:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788636676.253008:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225985792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636676.253379:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788636676.253392:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225986304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636676.253434:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225986304:12345-0@lo:400:kworker.0 Request processed in 45us (2646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636676.253440:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788636676.253533:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225985792:12345-0@lo:400:kworker.0 Request processed in 523us (2771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636676.253539:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788636676.253615:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225985536:0@lo:400:kworker.0 00010000:00080000:1.0:1788636676.253639:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03247100 x1875521225986048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636676.253652:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225986048:0@lo:400:kworker.0 00010000:00080000:1.0:1788636676.253666:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03247800 x1875521225985920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636676.253674:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03247800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225985920:0@lo:400:kworker.0 00010000:00080000:1.0:1788636676.253685:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02710380 x1875521225986432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636676.253693:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225986432:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.253738:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225985280:0@lo:400:kworker.0 00000100:00080000:2.0:1788636676.253906:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636676.253912:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636676.253915:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636676.253918:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636676.253992:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225985792:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.254011:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225986304:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.254024:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225985152:0@lo:400:kworker.0 00000100:00100000:1.0:1788636676.254233:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225985664:0@lo:400:kworker.0 00010000:00080000:1.0:1788636676.254270:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02710e00 x1875521225986176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636676.254280:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225986176:0@lo:400:kworker.0 00010000:00080000:3.0:1788636676.255440:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fccf480 x1875521225985024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636676.255480:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225985024:0@lo:13:osp-pre-1-0.0 00000020:00000004:1.0:1788636676.495586:0:12804:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788636676.496779:0:12804:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788636676.501854:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636677.527361:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636678.550291:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636678.806261:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225986560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636678.806375:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636678.806487:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225986560 00000100:00100000:1.0:1788636678.806498:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225986560 00000100:00100000:1.0:1788636678.806586:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788636678.806599:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225986560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636678.806643:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636678.806703:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225986560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636678.806711:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788636678.806739:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636678.806789:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf040990000 x1875521225986560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636678.806849:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225986560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636678.812031:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225986688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636678.812155:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636678.813133:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225986688 00000100:00100000:2.0:1788636678.813151:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225986688 00000100:00100000:2.0:1788636678.813265:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788636678.813278:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225986688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636678.813319:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636678.813414:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225986688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636678.813423:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788636678.813694:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636678.813752:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03245880 x1875521225986688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636678.813780:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225986688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636678.815187:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225986816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636678.815293:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636678.815375:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225986816 00000100:00100000:2.0:1788636678.815384:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225986816 00000100:00100000:2.0:1788636678.815461:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788636678.815473:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225986816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636678.815675:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636678.826074:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225986816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10583us (10762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636678.826157:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788636678.826448:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225986816:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1788636679.024677:0:12901:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788636679.025764:0:12901:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788636679.573521:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636679.833868:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225986944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636679.834015:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636679.834284:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225986944 00000100:00100000:1.0:1788636679.834296:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225986944 00000100:00100000:1.0:1788636679.834366:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788636679.834377:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225986944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636679.834437:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788636679.834505:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225986944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636679.834513:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788636679.834583:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225986944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636680.321477:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636680.321651:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636680.321683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636680.321718:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636680.321749:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636680.321788:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207027968 00000100:00100000:2.0:1788636680.321802:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207027968 00000100:00100000:2.0:1788636680.321910:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207028224 00000100:00100000:2.0:1788636680.321914:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207028224 00000100:00100000:2.0:1788636680.321932:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207028096 00000100:00100000:2.0:1788636680.321935:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207028096 00000100:00100000:2.0:1788636680.321948:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207028352 00000100:00100000:2.0:1788636680.321950:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207028352 00000100:00100000:2.0:1788636680.321967:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 192 00000100:00100000:2.0:1788636680.321978:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207027968:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636680.322090:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207027968:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 113us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636680.322100:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 192 00000100:00100000:2.0:1788636680.322122:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 193 00000100:00100000:2.0:1788636680.322632:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207028224:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636680.322701:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207028224:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 570us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636680.322715:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 193 00000100:00100000:2.0:1788636680.322734:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 194 00000100:00100000:2.0:1788636680.322742:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207028096:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636680.322775:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207028096:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 35us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636680.322782:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 194 00000100:00100000:2.0:1788636680.322793:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 195 00000100:00100000:2.0:1788636680.322800:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207028352:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636680.322843:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207028352:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 44us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636680.322850:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 195 00000100:00080000:2.0:1788636680.322877:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636680.322882:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636680.323256:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207027840 00000100:00100000:3.0:1788636680.323272:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207027840 00000100:00100000:3.0:1788636680.323332:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 316 00000100:00100000:3.0:1788636680.323341:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207027840:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636680.323376:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207027840:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 37us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636680.323454:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 316 00010000:00010000:3.0:1788636680.601695:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636681.365355:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225987200:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.365494:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.365571:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225987712:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.365595:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.365617:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225988224:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.365636:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.365669:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788636681.365675:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225987328:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.365706:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.365729:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521225987840:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.365751:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.365768:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521225988352:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.365789:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.365861:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225987328 00000100:00100000:0.0:1788636681.365871:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225987328 00000100:00100000:0.0:1788636681.365947:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788636681.365960:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225987328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366037:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225987328:12345-0@lo:400:kworker.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.366047:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788636681.366080:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225987200 00000100:00100000:0.0:1788636681.366083:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225987200 00000100:00100000:0.0:1788636681.366103:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225987712 00000100:00100000:0.0:1788636681.366105:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225987712 00000100:00100000:0.0:1788636681.366130:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225988224 00000100:00100000:0.0:1788636681.366133:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225988224 00000100:00100000:0.0:1788636681.366149:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225987840 00000100:00100000:0.0:1788636681.366171:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225987840 00000100:00100000:0.0:1788636681.366191:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225988352 00000100:00100000:0.0:1788636681.366194:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225988352 00000100:00100000:0.0:1788636681.366208:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788636681.366215:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225987200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366250:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225987200:12345-0@lo:400:kworker.0 Request processed in 35us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.366257:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788636681.366271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788636681.366278:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225987712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366305:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225987712:12345-0@lo:400:kworker.0 Request processed in 29us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.366311:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788636681.366322:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788636681.366327:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225988224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366353:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225988224:12345-0@lo:400:kworker.0 Request processed in 27us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.366359:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788636681.366370:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788636681.366375:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521225987840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366400:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521225987840:12345-0@lo:400:kworker.0 Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.366406:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788636681.366418:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788636681.366425:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521225988352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366451:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521225988352:12345-0@lo:400:kworker.0 Request processed in 27us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.366464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788636681.366513:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225987328:0@lo:400:kworker.0 00010000:00080000:0.0:1788636681.366530:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef023fce00 x1875521225987840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636681.366542:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521225987840:0@lo:400:kworker.0 00010000:00080000:0.0:1788636681.366555:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef023fc380 x1875521225988352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636681.366564:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521225988352:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366574:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225987200:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366582:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225987712:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366590:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225988224:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366665:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225987456:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366697:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.366714:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225987968:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366735:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.366750:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225988480:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366768:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.366793:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788636681.366798:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225987072:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366861:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.366898:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225987584:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.366954:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225988096:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.366975:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.366993:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225988608:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.367014:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636681.367042:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225987072 00000100:00100000:0.0:1788636681.367047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225987072 00000100:00100000:0.0:1788636681.367081:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788636681.367089:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521225987072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.367131:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521225987072:12345-0@lo:400:kworker.0 Request processed in 43us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.367137:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788636681.367179:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225987072:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.367197:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225987456 00000100:00100000:0.0:1788636681.367200:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225987456 00000100:00100000:0.0:1788636681.367219:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788636681.367225:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225987456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.367259:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521225987456:12345-0@lo:400:kworker.0 Request processed in 34us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.367266:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788636681.367292:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521225987456:0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.367325:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225987584 00000100:00100000:0.0:1788636681.367329:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225987584 00000100:00100000:0.0:1788636681.367355:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788636681.367362:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225987584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.367410:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225987584:12345-0@lo:400:kworker.0 Request processed in 48us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.367417:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788636681.367438:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225987968 00000100:00100000:0.0:1788636681.367442:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225987968 00000100:00100000:0.0:1788636681.367471:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225988480 00000100:00100000:0.0:1788636681.367474:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225988480 00000100:00100000:0.0:1788636681.367489:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225988096 00000100:00100000:0.0:1788636681.367491:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225988096 00000100:00100000:0.0:1788636681.367502:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225988608 00000100:00100000:0.0:1788636681.367504:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225988608 00000100:00100000:0.0:1788636681.367515:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788636681.367520:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225987968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.367554:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225987968:12345-0@lo:400:kworker.0 Request processed in 34us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.367559:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788636681.367569:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788636681.367575:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225988480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.367600:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225988480:12345-0@lo:400:kworker.0 Request processed in 26us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.367605:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788636681.367614:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788636681.367620:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225988096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.367643:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225988096:12345-0@lo:400:kworker.0 Request processed in 23us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.367648:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788636681.367658:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788636681.367671:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225988608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636681.367722:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225988608:12345-0@lo:400:kworker.0 Request processed in 51us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636681.367728:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788636681.367765:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225987584:0@lo:400:kworker.0 00010000:00080000:0.0:1788636681.367777:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef023ffb80 x1875521225988096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636681.367787:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225988096:0@lo:400:kworker.0 00010000:00080000:0.0:1788636681.367796:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03519f80 x1875521225988608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636681.367804:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225988608:0@lo:400:kworker.0 00010000:00080000:0.0:1788636681.367850:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef023fed80 x1875521225987968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636681.367858:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225987968:0@lo:400:kworker.0 00010000:00080000:0.0:1788636681.367869:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03519500 x1875521225988480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788636681.367970:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636681.367976:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636681.367979:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636681.367982:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636681.371611:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225988736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636681.371725:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636681.372107:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225988864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636681.372141:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636681.373154:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225988736 00000100:00100000:2.0:1788636681.373168:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225988736 00000100:00100000:2.0:1788636681.373231:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225988864 00000100:00100000:2.0:1788636681.373234:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225988864 00000100:00100000:2.0:1788636681.373253:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788636681.373264:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225988736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636681.373308:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636681.373471:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788636681.373483:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225988864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636681.373497:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636681.373541:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03608380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225988864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636681.373549:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1788636681.373604:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03608700 x1875521225988864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636681.373628:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03608700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225988864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636681.373691:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225988736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636681.373713:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1788636681.373867:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03244a80 x1875521225988736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636681.373893:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225988736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636681.374463:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225988480:0@lo:400:kworker.0 00000001:00100000:0.0:1788636681.380788:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1e9819a8-2c70-4ce1-8555-108bb564fc06 00000020:00000080:0.0:1788636681.380803:0:8431:0:(genops.c:885:class_export_put()) final put ffff9cf03fc88000/1e9819a8-2c70-4ce1-8555-108bb564fc06 00000020:00000080:3.0:1788636681.381016:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc88000/1e9819a8-2c70-4ce1-8555-108bb564fc06 for lustre-OST0000 00000020:00000080:3.0:1788636681.381072:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03fc8f000 for lustre-OST0000 00000001:00100000:2.0:1788636681.383084:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1e9819a8-2c70-4ce1-8555-108bb564fc06 00000020:00000080:2.0:1788636681.383098:0:9516:0:(genops.c:885:class_export_put()) final put ffff9cf03fc8e800/1e9819a8-2c70-4ce1-8555-108bb564fc06 00000020:00000080:0.0:1788636681.383192:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc8e800/1e9819a8-2c70-4ce1-8555-108bb564fc06 for lustre-OST0001 00000020:00000080:0.0:1788636681.383260:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03fc8a800 for lustre-OST0001 00010000:00010000:0.0:1788636681.621009:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636682.645712:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788636683.368112:0:13046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788636683.669597:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636683.926158:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636683.926227:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225988992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636683.926371:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636683.926957:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636683.926976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225989120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636683.927033:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636683.933681:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225988992 00000100:00100000:0.0:1788636683.933705:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225988992 00000100:00100000:0.0:1788636683.933830:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788636683.933844:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225988992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636683.933928:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636683.934362:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225989120 00000100:00100000:2.0:1788636683.934370:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225989120 00000100:00100000:2.0:1788636683.934428:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788636683.934436:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225989120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636683.934464:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636683.934602:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225989120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 167us (7568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636683.934611:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788636683.934645:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636683.935103:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225988992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1261us (8731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636683.935113:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788636683.935171:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225988992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636683.935337:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636683.935354:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225989248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636683.935480:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636683.935723:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225989248 00000100:00100000:2.0:1788636683.935730:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225989248 00000100:00100000:2.0:1788636683.935794:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788636683.935803:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225989248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636683.935859:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636683.935902:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225989248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636683.935938:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1788636683.936431:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03244a80 x1875521225989120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636683.936465:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225989120:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788636683.936787:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02461180 x1875521225989248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636683.936837:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225989248:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788636683.936874:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788636684.694087:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636684.951106:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636684.951132:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225989376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636684.951204:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636684.951271:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225989376 00000100:00100000:3.0:1788636684.951281:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225989376 00000100:00100000:3.0:1788636684.951342:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788636684.951352:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225989376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636684.951384:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788636684.951447:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225989376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636684.951455:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788636684.951501:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225989376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636685.441130:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636685.442238:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207028480 00000100:00100000:0.0:1788636685.442251:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207028480 00000100:00100000:0.0:1788636685.442313:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 318 00000100:00100000:0.0:1788636685.442325:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207028480:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636685.442762:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207028480:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 437us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636685.442793:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 318 00000100:00100000:3.0:1788636685.443277:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636685.443323:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207028608 00000100:00100000:0.0:1788636685.443330:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207028608 00000100:00080000:2.0:1788636685.443653:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636685.443766:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 202 00000100:00100000:0.0:1788636685.443788:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207028608:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636685.444089:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207028608:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 312us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636685.444100:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 202 00000100:00100000:3.0:1788636685.448055:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636685.448095:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636685.448131:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636685.448161:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207028864 00000100:00100000:3.0:1788636685.448169:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207028864 00000100:00100000:3.0:1788636685.448231:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207028736 00000100:00100000:3.0:1788636685.448234:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207028736 00000100:00100000:3.0:1788636685.448247:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207028992 00000100:00100000:3.0:1788636685.448249:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207028992 00000100:00100000:3.0:1788636685.448264:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 203 00000100:00100000:3.0:1788636685.448273:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207028864:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636685.448344:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207028864:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 72us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636685.448352:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 203 00000100:00100000:3.0:1788636685.448366:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 204 00000100:00100000:3.0:1788636685.448371:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207028736:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636685.448390:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207028736:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 19us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636685.448395:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 204 00000100:00100000:3.0:1788636685.448403:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 205 00000100:00100000:3.0:1788636685.448421:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207028992:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636685.448444:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03608700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207028992:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 24us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636685.448449:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 205 00000100:00080000:3.0:1788636685.448560:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636685.448564:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636685.718060:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636686.485500:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225989504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636686.485616:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636686.486135:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225989504 00000100:00100000:2.0:1788636686.486145:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225989504 00000100:00100000:2.0:1788636686.486212:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788636686.486223:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225989504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636686.486257:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636686.486303:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225989504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636686.486310:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1788636686.486332:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788636686.486463:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03246a00 x1875521225989504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636686.486489:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225989504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636686.487125:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225989760:0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487171:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636686.487195:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225990272:0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487214:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636686.487234:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225990784:0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487250:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636686.487270:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788636686.487275:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225989888:0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487297:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636686.487311:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521225990400:0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487328:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636686.487340:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521225990912:0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487357:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636686.487379:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225989760 00000100:00100000:3.0:1788636686.487385:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225989760 00000100:00100000:3.0:1788636686.487413:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225990272 00000100:00100000:3.0:1788636686.487415:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225990272 00000100:00100000:3.0:1788636686.487444:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225990784 00000100:00100000:3.0:1788636686.487447:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225990784 00000100:00100000:3.0:1788636686.487459:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225990400 00000100:00100000:3.0:1788636686.487470:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225990400 00000100:00100000:3.0:1788636686.487483:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225990912 00000100:00100000:3.0:1788636686.487485:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225990912 00000100:00100000:3.0:1788636686.487499:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788636686.487506:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225989760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487554:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521225989760:12345-0@lo:400:kworker.0 Request processed in 48us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636686.487573:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788636686.487591:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788636686.487597:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225990272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487626:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521225990272:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636686.487632:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788636686.487643:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788636686.487649:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225990784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487673:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521225990784:12345-0@lo:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636686.487680:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788636686.487691:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788636686.487697:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521225990400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487721:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521225990400:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636686.487726:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788636686.487738:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788636686.487743:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521225990912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487767:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521225990912:12345-0@lo:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636686.487780:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00080000:3.0:1788636686.487869:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03724700 x1875521225990400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636686.487881:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521225990400:0@lo:400:kworker.0 00010000:00080000:3.0:1788636686.487892:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03724000 x1875521225990912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636686.487901:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521225990912:0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487912:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521225989760:0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487921:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521225990272:0@lo:400:kworker.0 00000100:00100000:3.0:1788636686.487931:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521225990784:0@lo:400:kworker.0 00000100:00080000:2.0:1788636686.488566:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636686.488574:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636686.489153:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225989632:0@lo:400:kworker.0 00000100:00100000:1.0:1788636686.489237:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636686.489286:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225990144:0@lo:400:kworker.0 00000100:00100000:1.0:1788636686.489312:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636686.489330:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225990656:0@lo:400:kworker.0 00000100:00100000:1.0:1788636686.489354:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636686.489381:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788636686.489389:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225990016:0@lo:400:kworker.0 00000100:00100000:1.0:1788636686.489413:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636686.489429:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225990528:0@lo:400:kworker.0 00000100:00100000:1.0:1788636686.489465:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636686.489483:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225991040:0@lo:400:kworker.0 00000100:00100000:1.0:1788636686.489500:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636686.489533:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225990656 00000100:00100000:1.0:1788636686.489542:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225990656 00000100:00100000:1.0:1788636686.490122:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225990528 00000100:00100000:1.0:1788636686.490128:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225990528 00000100:00100000:1.0:1788636686.490147:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225991040 00000100:00100000:1.0:1788636686.490150:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225991040 00000100:00100000:1.0:1788636686.490168:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788636686.490176:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225990656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636686.490235:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225990656:12345-0@lo:400:kworker.0 Request processed in 60us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636686.490242:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788636686.490258:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788636686.490264:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225990528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636686.490288:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225990528:12345-0@lo:400:kworker.0 Request processed in 24us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636686.490303:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788636686.490313:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788636686.490320:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225991040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636686.490346:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225991040:12345-0@lo:400:kworker.0 Request processed in 27us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636686.490351:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1788636686.490393:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03726680 x1875521225990528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636686.490407:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225990528:0@lo:400:kworker.0 00010000:00080000:1.0:1788636686.490418:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03727800 x1875521225991040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636686.490426:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225991040:0@lo:400:kworker.0 00000100:00100000:0.0:1788636686.490540:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225989888 00000100:00100000:0.0:1788636686.490545:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225989888 00000100:00100000:0.0:1788636686.490585:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225990144 00000100:00100000:0.0:1788636686.490588:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225990144 00000100:00100000:0.0:1788636686.490603:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788636686.490609:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225989888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636686.490664:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225989888:12345-0@lo:400:kworker.0 Request processed in 56us (3366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636686.490670:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788636686.490683:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788636686.490689:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225990144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636686.490726:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225990144:12345-0@lo:400:kworker.0 Request processed in 37us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636686.490733:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788636686.490752:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225990016 00000100:00100000:0.0:1788636686.490755:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225990016 00000100:00100000:0.0:1788636686.490779:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788636686.490785:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225990016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636686.490843:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225990016:12345-0@lo:400:kworker.0 Request processed in 59us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636686.490849:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788636686.490905:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225989888:0@lo:400:kworker.0 00000100:00100000:2.0:1788636686.491262:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225989632 00000100:00100000:2.0:1788636686.491267:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225989632 00000100:00100000:2.0:1788636686.491303:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788636686.491309:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225989632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636686.491342:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225989632:12345-0@lo:400:kworker.0 Request processed in 34us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636686.491349:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:2.0:1788636686.491381:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636686.491386:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636686.491545:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225989632:0@lo:400:kworker.0 00000100:00100000:2.0:1788636686.492163:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636686.492178:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225991168:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636686.492221:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636686.492257:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225991168 00000100:00100000:2.0:1788636686.492273:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225991168 00000100:00100000:2.0:1788636686.492303:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788636686.492310:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225991168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636686.492326:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636686.492361:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225991168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636686.492367:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1788636686.492397:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03724380 x1875521225991168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636686.492412:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225991168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636686.495287:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225990144:0@lo:400:kworker.0 00010000:00080000:0.0:1788636686.495310:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03727100 x1875521225990656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636686.495320:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225990656:0@lo:400:kworker.0 00000100:00100000:0.0:1788636686.495363:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225990016:0@lo:400:kworker.0 00010000:00010000:3.0:1788636686.741129:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788636687.157147:0:13193:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5b013ee0 20000000:00000080:0.0:1788636687.157351:0:13193:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cef030d9800 uarg=0000000000000000 20000000:01000000:0.0:1788636687.157396:0:13193:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788636687.157401:0:13193:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788636687.157406:0:13193:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788636687.158325:0:13194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788636687.158411:0:13193:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788636687.171454:0:13193:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788636687.172013:0:13193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.172035:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8382d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8382cc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.172043:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf000031000/0x5b741ef42e8382e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8382da expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.172050:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03aab1e00/0x5b741ef42e8382ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8382e8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.172056:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c6000/0x5b741ef42e8382fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8382f6 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.172084:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e838304 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38eda expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.172091:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e838319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f19 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.172098:0:13193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.172153:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e838319 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f19 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.172171:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e838319 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f19 expref: 12 pid: 6513 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636687.172190:0:13193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225991296:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636687.176050:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e838304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38eda expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176068:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e838304 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38eda expref: 12 pid: 6516 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636687.176084:0:13193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225991424:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636687.176172:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c6000/0x5b741ef42e8382fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8382f6 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176181:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0113c6000/0x5b741ef42e8382fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8382f6 expref: 23 pid: 6516 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636687.176211:0:13193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225991552:0@lo:104: 00000100:00100000:1.0:1788636687.176251:0:13193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636687.176294:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03aab1e00/0x5b741ef42e8382ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8382e8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176303:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf03aab1e00/0x5b741ef42e8382ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8382e8 expref: 23 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636687.176312:0:13193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03793100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225991680:0@lo:104: 00000100:00100000:1.0:1788636687.176335:0:13193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636687.176370:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225991552 00000100:00100000:1.0:1788636687.176378:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225991552 00000100:00100000:1.0:1788636687.176416:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225991680 00000100:00100000:1.0:1788636687.176420:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225991680 00000100:00100000:1.0:1788636687.176434:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788636687.176442:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:13193:x1875521225991552:12345-0@lo:104: 00010000:00010000:1.0:1788636687.176457:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176517:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636687.176523:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:13193:x1875521225991552:12345-0@lo:104: Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636687.176529:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788636687.176547:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788636687.176553:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:13193:x1875521225991680:12345-0@lo:104: 00010000:00010000:1.0:1788636687.176560:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176605:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788636687.176610:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:13193:x1875521225991680:12345-0@lo:104: Request processed in 59us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636687.176616:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1788636687.176632:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636687.176637:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176644:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37c00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636687.176648:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176657:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636687.176664:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636687.176670:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636687.176705:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176712:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636687.176727:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176734:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e8382f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382fd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176757:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636687.176761:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176766:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0a00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636687.176769:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176775:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636687.176781:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636687.176786:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636687.176800:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176837:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636687.176844:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176851:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e8382e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176860:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636687.176862:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636687.176864:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636687.176885:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf000031000/0x5b741ef42e8382e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8382da expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.176899:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf000031000/0x5b741ef42e8382e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8382da expref: 23 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636687.176908:0:13193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03791880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225992064:0@lo:104: 00000100:00100000:1.0:1788636687.176933:0:13193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636687.176953:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225992064 00000100:00100000:1.0:1788636687.176958:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225992064 00000100:00100000:1.0:1788636687.176975:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788636687.176980:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:13193:x1875521225992064:12345-0@lo:104: 00010000:00010000:1.0:1788636687.176988:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177018:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636687.177024:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03791180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:13193:x1875521225992064:12345-0@lo:104: Request processed in 44us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636687.177029:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788636687.177055:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8382d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8382cc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177063:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8382d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8382cc expref: 23 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636687.177070:0:13193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03793b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225992192:0@lo:104: 00000100:00100000:1.0:1788636687.177093:0:13193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636687.177111:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225992192 00000100:00100000:1.0:1788636687.177114:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225992192 00000100:00100000:1.0:1788636687.177130:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788636687.177135:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:13193:x1875521225992192:12345-0@lo:104: 00010000:00010000:1.0:1788636687.177147:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177177:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788636687.177182:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:13193:x1875521225992192:12345-0@lo:104: Request processed in 48us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636687.177188:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788636687.177202:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636687.177206:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177211:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636687.177214:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177220:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636687.177226:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636687.177231:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636687.177244:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177250:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636687.177264:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177271:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e8382da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177288:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636687.177291:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177295:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6c00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636687.177299:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177305:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636687.177311:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636687.177316:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636687.177329:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177335:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636687.177341:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177347:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6c00/0x5b741ef42e8382cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8382d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.177361:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636687.177363:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636687.177364:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636687.177375:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225992320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636687.177408:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636687.177427:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636687.177433:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225992448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636687.177451:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636687.177476:0:13193:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636687.177496:0:13193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225991552:0@lo:104: 00000100:00100000:1.0:1788636687.177505:0:13193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03793100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225991680:0@lo:104: 00000100:00100000:1.0:1788636687.177512:0:13193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03791880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225992064:0@lo:104: 00000100:00100000:1.0:1788636687.177518:0:13193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03793b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225992192:0@lo:104: 00010000:00010000:3.0:1788636687.178141:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636687.178154:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225991936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636687.178190:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636687.178221:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636687.178227:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225991808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636687.178246:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636687.178262:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636687.178273:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225992320 00000100:00100000:3.0:1788636687.178278:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225992320 00010000:00010000:3.0:1788636687.178303:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf000031000/0x5b741ef42e8382e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8382da expref: 24 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636687.178401:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225992448 00000100:00100000:3.0:1788636687.178413:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225992448 00010000:00010000:3.0:1788636687.178428:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8382d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8382cc expref: 25 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636687.178440:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225991936 00000100:00100000:3.0:1788636687.178442:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225991936 00010000:00010000:3.0:1788636687.178451:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03aab1e00/0x5b741ef42e8382ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8382e8 expref: 26 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636687.178467:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225991808 00000100:00100000:3.0:1788636687.178470:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225991808 00010000:00010000:3.0:1788636687.178479:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c6000/0x5b741ef42e8382fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8382f6 expref: 27 pid: 6516 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636687.178505:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788636687.178511:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+27:3648:x1875521225992320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636687.178522:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636687.178527:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf000031000/0x5b741ef42e8382e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8382da expref: 27 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178536:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf000031000/0x5b741ef42e8382e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8382da expref: 27 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178548:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031000/0x5b741ef42e8382e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8382da expref: 27 pid: 6513 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178562:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636687.178595:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+26:3648:x1875521225992320:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636687.178602:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788636687.178616:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788636687.178628:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+25:3648:x1875521225992448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636687.178636:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636687.178641:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8382d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8382cc expref: 25 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178649:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8382d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8382cc expref: 25 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178658:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8382d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8382cc expref: 25 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178667:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636687.178690:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521225992448:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636687.178696:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788636687.178709:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788636687.178714:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:3647:x1875521225991936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636687.178721:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636687.178724:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03aab1e00/0x5b741ef42e8382ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8382e8 expref: 23 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178731:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03aab1e00/0x5b741ef42e8382ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8382e8 expref: 23 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178739:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab1e00/0x5b741ef42e8382ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8382e8 expref: 23 pid: 6514 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178747:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636687.178772:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:3647:x1875521225991936:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636687.178783:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788636687.178795:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788636687.178801:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3647:x1875521225991808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636687.178841:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636687.178846:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c6000/0x5b741ef42e8382fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8382f6 expref: 21 pid: 6516 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178856:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c6000/0x5b741ef42e8382fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8382f6 expref: 21 pid: 6516 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178866:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c6000/0x5b741ef42e8382fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8382f6 expref: 21 pid: 6516 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.178873:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636687.178895:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03724000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:3647:x1875521225991808:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636687.178902:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788636687.179042:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636687.179074:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225992448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636687.179083:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521225992320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636687.179111:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225991808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636687.179120:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521225991936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636687.179136:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207029120 00000100:00100000:3.0:1788636687.179139:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207029120 00010000:00010000:3.0:1788636687.179155:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e838319 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f19 expref: 13 pid: 6513 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636687.179179:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 44 00000100:00100000:3.0:1788636687.179186:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207029120:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636687.179194:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636687.179198:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e838319 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f19 expref: 13 pid: 6513 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.179207:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e838319 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f19 expref: 13 pid: 6513 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.179218:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636687.179254:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207029120:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 68us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636687.179261:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 44 00010000:00010000:0.0:1788636687.180904:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e838319 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f19 expref: 12 pid: 6513 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636687.180953:0:13193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225991296:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636687.183166:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636687.183227:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207029248 00000100:00100000:3.0:1788636687.183236:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207029248 00010000:00010000:3.0:1788636687.183271:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e838304 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38eda expref: 12 pid: 6516 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636687.183310:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 45 00000100:00100000:3.0:1788636687.183320:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3da5b26b-f5ec-400d-b893-346cfc652707+12:2401:x1875521207029248:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636687.183334:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636687.183340:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e838304 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38eda expref: 12 pid: 6516 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183351:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e838304 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38eda expref: 12 pid: 6516 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183387:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183396:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183412:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183419:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183426:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183433:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183439:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37e00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636687.183443:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183774:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183787:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636687.183800:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636687.183899:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3da5b26b-f5ec-400d-b893-346cfc652707+12:2401:x1875521207029248:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 579us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636687.183915:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 45 00010000:00010000:0.0:1788636687.184263:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e838304 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38eda expref: 11 pid: 6516 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636687.184278:0:13193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875521225991424:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636687.184309:0:13193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636687.184319:0:13193:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636687.184325:0:13193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636687.184331:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e83833c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636687.766137:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636688.710086:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636688.710245:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207029376 00000100:00100000:2.0:1788636688.710330:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207029376 00000100:00100000:2.0:1788636688.710437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 320 00000100:00100000:2.0:1788636688.710448:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+11:6174:x1875521207029376:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636688.710466:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636688.710486:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e838343 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636688.710529:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e838343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f4a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636688.710541:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e838343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f4a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636688.710551:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1400, rc 0) 00000100:00100000:2.0:1788636688.710613:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207029376:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 Request processed in 167us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636688.710634:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 320 00000100:00100000:1.0:1788636688.715564:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636688.715676:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207029504 00000100:00100000:0.0:1788636688.715686:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207029504 00000100:00100000:0.0:1788636688.715750:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 321 00000100:00100000:0.0:1788636688.715762:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207029504:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636688.716065:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207029504:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 Request processed in 304us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636688.716073:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 321 00000100:00100000:1.0:1788636688.725020:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636688.725103:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207029632 00000100:00100000:3.0:1788636688.725113:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207029632 00000100:00100000:3.0:1788636688.725174:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 322 00000100:00100000:3.0:1788636688.725185:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207029632:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636688.725326:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207029632:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 Request processed in 142us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636688.725334:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 322 00000100:00100000:0.0:1788636688.751881:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636688.752554:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207029760 00000100:00100000:2.0:1788636688.752568:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207029760 00000100:00100000:2.0:1788636688.752643:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 323 00000100:00100000:2.0:1788636688.752656:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207029760:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636688.752677:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636688.752698:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab0c00/0x5b741ef42e83834a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f51 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636688.752731:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab0c00/0x5b741ef42e83834a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f51 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636688.752744:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab0c00/0x5b741ef42e83834a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f51 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636688.752753:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0c00, rc 0) 00000100:00100000:2.0:1788636688.753175:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:6174:x1875521207029760:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 Request processed in 521us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636688.753182:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 323 00000100:00100000:0.0:1788636688.772733:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636688.772840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207029888 00000100:00100000:0.0:1788636688.772852:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207029888 00000100:00100000:0.0:1788636688.772927:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 324 00000100:00100000:0.0:1788636688.772940:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:6174:x1875521207029888:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636688.773120:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:6174:x1875521207029888:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 Request processed in 182us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636688.773129:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 324 00000100:00100000:1.0:1788636688.782070:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636688.782445:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207030016 00000100:00100000:2.0:1788636688.782456:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207030016 00000100:00100000:2.0:1788636688.782512:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 325 00000100:00100000:2.0:1788636688.782532:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:6174:x1875521207030016:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636688.782714:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:6174:x1875521207030016:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 Request processed in 182us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636688.782722:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 325 00010000:00010000:2.0:1788636688.789113:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636689.047272:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225992576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636689.047354:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636689.048657:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225992576 00000100:00100000:2.0:1788636689.048669:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225992576 00000100:00100000:2.0:1788636689.048738:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788636689.048750:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225992576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636689.048804:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636689.048887:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225992576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636689.048894:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788636689.048915:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636689.048954:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03244a80 x1875521225992576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636689.048975:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225992576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636689.048995:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636689.049004:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225992704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636689.049041:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636689.049077:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225992704 00000100:00100000:2.0:1788636689.049082:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225992704 00000100:00100000:2.0:1788636689.049109:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788636689.049115:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225992704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636689.049143:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636689.049177:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225992704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636689.049183:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788636689.049226:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225992704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636689.057372:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225992832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636689.060724:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636689.062998:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225992832 00000100:00100000:1.0:1788636689.063014:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225992832 00000100:00100000:1.0:1788636689.063089:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788636689.063099:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225992832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636689.063128:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636689.063213:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225992832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636689.063220:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788636689.063272:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03792d80 x1875521225992832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636689.063307:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225992832:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788636689.065593:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1788636689.176603:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636689.176612:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf03a765800 from 7 10000000:01000000:2.0:1788636689.176618:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636689.176670:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636689.176682:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636689.176694:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636689.176720:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225992960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636689.177841:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636689.177974:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef036e9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788636689.178069:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225992960 00000100:00100000:0.0:1788636689.178081:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225992960 00000100:00100000:0.0:1788636689.178134:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788636689.178144:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521225992960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636689.178158:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636689.178174:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e838358 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e838351 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636689.178200:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e838358 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e838351 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636689.178211:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e838358 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838351 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636689.178220:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6400, rc 0) 00000100:00100000:0.0:1788636689.178271:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225992960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636689.178278:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788636689.179038:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225992960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636689.179060:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636689.179071:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636689.179148:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636689.179184:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636689.179211:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef036e9840 going to sleep for 11 seconds 00000100:00100000:3.0:1788636689.181889:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225993088 00000100:00100000:3.0:1788636689.181913:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225993088 00000100:00100000:3.0:1788636689.181969:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788636689.181979:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225993088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636689.182162:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225993088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (2976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636689.182170:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788636689.188912:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636689.188974:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636689.189044:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636689.189086:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636689.189224:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225993216 00000100:00100000:1.0:1788636689.189231:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225993216 00000100:00100000:1.0:1788636689.189286:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788636689.189296:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225993216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636689.189412:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225993216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636689.189420:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788636689.189725:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788636689.193181:0:13226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788636689.193625:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788636689.193657:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636689.193669:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.193682:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636689.193692:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788636689.193694:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00f1a3000 from 7 10000000:01000000:3.0:1788636689.193697:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636689.193731:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.193740:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.193750:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636689.193774:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636689.194043:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636689.194087:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636689.194587:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225993344 00000100:00100000:2.0:1788636689.194596:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225993344 00000100:00100000:2.0:1788636689.194656:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788636689.194666:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521225993344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636689.194680:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636689.194694:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e838366 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83835f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636689.194718:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e838366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83835f expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636689.194729:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e838366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83835f expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636689.194738:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1a00, rc 0) 00000100:00100000:2.0:1788636689.194777:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225993344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636689.194785:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788636689.197671:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636689.197704:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.197718:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636689.197839:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636689.197929:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636689.197974:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636689.198295:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225993472 00000100:00100000:2.0:1788636689.198303:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225993472 00000100:00100000:2.0:1788636689.198349:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788636689.198357:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225993472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636689.198491:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225993472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636689.198499:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788636689.208880:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636689.208980:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636689.209069:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636689.209096:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636689.209118:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225993600 00000100:00100000:3.0:1788636689.209124:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225993600 00000100:00100000:3.0:1788636689.209167:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788636689.209176:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225993600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636689.209282:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225993600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636689.209291:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788636689.209340:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788636689.211853:0:13227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788636689.211935:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788636689.211959:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636689.211971:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.211982:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636689.211994:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788636689.211997:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00f150000 from 7 10000000:01000000:3.0:1788636689.212000:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636689.212043:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.212064:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.212077:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636689.212106:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636689.212176:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636689.212204:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636689.212229:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225993728 00000100:00100000:3.0:1788636689.212235:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225993728 00000100:00100000:3.0:1788636689.212279:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788636689.212289:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521225993728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636689.212300:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636689.212313:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf000031000/0x5b741ef42e838374 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83836d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.212337:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf000031000/0x5b741ef42e838374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83836d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.212349:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf000031000/0x5b741ef42e838374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83836d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.212358:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000031000, rc 0) 00000100:00100000:3.0:1788636689.212399:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225993728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636689.212406:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788636689.214748:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636689.214777:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.214789:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636689.215712:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636689.215777:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636689.216027:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636689.222632:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225993856 00000100:00100000:1.0:1788636689.222651:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225993856 00000100:00100000:1.0:1788636689.222833:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788636689.222845:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225993856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636689.223042:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225993856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (7263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636689.223050:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788636689.223157:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636689.223230:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636689.223278:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636689.230315:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033840 going to sleep for 11 seconds 00000100:00100000:1.0:1788636689.230738:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225993984 00000100:00100000:1.0:1788636689.230748:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225993984 00000100:00100000:1.0:1788636689.230840:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788636689.230851:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225993984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636689.231016:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225993984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (7737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636689.231023:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788636689.231270:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225993984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788636689.236744:0:13228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788636689.237169:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788636689.237196:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636689.237208:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636689.237220:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636689.237243:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788636689.237245:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00324c000 from 7 10000000:01000000:1.0:1788636689.237248:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636689.237286:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636689.237294:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636689.237304:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636689.237327:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225994112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636689.237389:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636689.237424:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aba29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636689.237443:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225994112 00000100:00100000:1.0:1788636689.237449:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225994112 00000100:00100000:1.0:1788636689.237491:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788636689.237500:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521225994112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636689.237524:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636689.237620:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab36800/0x5b741ef42e838382 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83837b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636689.237644:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab36800/0x5b741ef42e838382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83837b expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636689.237656:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab36800/0x5b741ef42e838382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83837b expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636689.237676:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36800, rc 0) 00000100:00100000:1.0:1788636689.237714:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225994112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636689.237721:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788636689.237766:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225994112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636689.237779:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636689.237789:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636689.237874:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225994240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636689.237969:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636689.237984:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aba29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636689.237996:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225994240 00000100:00100000:1.0:1788636689.238000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225994240 00000100:00100000:1.0:1788636689.238019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788636689.238025:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225994240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636689.238120:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225994240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636689.238127:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788636689.238154:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225994240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636689.238180:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225994368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636689.238220:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636689.238238:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aba29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636689.238249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225994368 00000100:00100000:1.0:1788636689.238252:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225994368 00000100:00100000:1.0:1788636689.238273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788636689.238279:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225994368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636689.238345:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521225994368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636689.238351:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788636689.238385:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521225994368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788636689.245359:0:13229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788636689.247693:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788636689.247741:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636689.247757:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636689.247770:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636689.813051:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636690.069008:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636690.069040:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225994496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636690.069141:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636690.069452:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225994496 00000100:00100000:2.0:1788636690.069461:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225994496 00000100:00100000:2.0:1788636690.069528:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788636690.069539:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225994496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788636690.069611:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788636690.069678:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225994496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636690.069686:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788636690.069745:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225994496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636690.559887:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636690.559914:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636690.559956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636690.559977:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207030272 00000100:00100000:0.0:1788636690.559979:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636690.559987:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207030272 00000100:00100000:0.0:1788636690.559999:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636690.560021:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207030144 00000100:00100000:0.0:1788636690.560024:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207030144 00000100:00100000:2.0:1788636690.560044:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207030528 00000100:00100000:2.0:1788636690.560047:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207030528 00000100:00100000:0.0:1788636690.560052:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 338 00000100:00100000:2.0:1788636690.560060:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207030400 00000100:00100000:2.0:1788636690.560062:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207030400 00000100:00100000:0.0:1788636690.560062:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207030144:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636690.560074:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207030656 00000100:00100000:2.0:1788636690.560075:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207030656 00000100:00100000:2.0:1788636690.560090:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 212 00000100:00100000:2.0:1788636690.560096:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207030272:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636690.560139:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207030144:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636690.560148:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 338 00000100:00100000:0.0:1788636690.560183:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 213 00000100:00100000:0.0:1788636690.560191:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207030528:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636690.561764:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788636690.561791:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788636690.565275:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 214 00000100:00100000:1.0:1788636690.565294:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207030400:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636690.567455:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207030272:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 7346us (7563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636690.567470:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 212 00000100:00100000:2.0:1788636690.567507:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788636690.567521:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 215 00000100:00100000:2.0:1788636690.567533:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207030656:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636690.567617:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207030656:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 88us (7616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636690.567624:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 215 00000100:00100000:0.0:1788636690.569400:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207030528:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 9200us (9474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636690.569413:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 213 00000100:00080000:0.0:1788636690.569451:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636690.569457:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636690.569713:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207030400:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 4423us (9729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636690.569722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 214 00010000:00010000:2.0:1788636690.840135:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636691.605841:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225994752:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.606383:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225994624:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.606451:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636691.606507:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225995136:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.606536:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636691.606563:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225995648:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.606594:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636691.606609:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225996160:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.606626:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636691.606659:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225995008:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.606688:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636691.606706:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225995520:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.606727:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636691.606740:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225996032:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.606777:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636691.606796:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788636691.606802:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225994880:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.606842:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636691.606858:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225995392:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.607232:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636691.607252:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225995904:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.607273:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636691.607300:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225994624 00000100:00100000:1.0:1788636691.607307:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225994624 00000100:00100000:1.0:1788636691.607352:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788636691.607361:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225994624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.607406:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225994624:12345-0@lo:400:kworker.0 Request processed in 46us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636691.607412:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788636691.607443:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225995136 00000100:00100000:1.0:1788636691.607454:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225995136 00000100:00100000:1.0:1788636691.607837:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225994880 00000100:00100000:1.0:1788636691.607842:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225994880 00000100:00100000:1.0:1788636691.607858:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788636691.607864:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225995136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.608841:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225995136:12345-0@lo:400:kworker.0 Request processed in 969us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636691.608853:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788636691.609619:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636691.609658:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225995264:0@lo:400:kworker.0 00000100:00100000:3.0:1788636691.609685:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636691.609701:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225995776:0@lo:400:kworker.0 00000100:00100000:3.0:1788636691.609721:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636691.609740:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225996288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636691.609762:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636691.609831:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788636691.609844:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225994880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.610087:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225995648 00000100:00100000:1.0:1788636691.610095:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225995648 00000100:00100000:3.0:1788636691.610280:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225994880:12345-0@lo:400:kworker.0 Request processed in 440us (3436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636691.610288:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788636691.610334:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225996288 00000100:00100000:3.0:1788636691.610337:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225996288 00000100:00100000:3.0:1788636691.610363:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788636691.610371:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225996288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636691.610392:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636691.610424:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225996288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636691.610430:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788636691.610447:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225996416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636691.610546:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225996160 00000100:00100000:1.0:1788636691.610552:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225996160 00000100:00100000:1.0:1788636691.610570:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225995520 00000100:00100000:1.0:1788636691.610573:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225995520 00000100:00100000:1.0:1788636691.610584:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225996032 00000100:00100000:1.0:1788636691.610586:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225996032 00000100:00100000:1.0:1788636691.610598:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788636691.610604:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225995648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.610637:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225995648:12345-0@lo:400:kworker.0 Request processed in 33us (4042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636691.610643:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788636691.610654:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788636691.610660:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225996160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.610683:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225996160:12345-0@lo:400:kworker.0 Request processed in 24us (4056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636691.610689:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788636691.610699:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788636691.610704:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225995520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.610737:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225995520:12345-0@lo:400:kworker.0 Request processed in 33us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636691.610743:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788636691.610752:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788636691.610757:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225996032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.610794:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225996032:12345-0@lo:400:kworker.0 Request processed in 36us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636691.610800:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788636691.610841:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225995008 00000100:00100000:1.0:1788636691.610845:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225995008 00000100:00100000:1.0:1788636691.610861:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225995392 00000100:00100000:1.0:1788636691.610864:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225995392 00000100:00100000:1.0:1788636691.610876:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225995904 00000100:00100000:1.0:1788636691.610878:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225995904 00000100:00100000:1.0:1788636691.610905:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225994752 00000100:00100000:1.0:1788636691.610907:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225994752 00000100:00100000:1.0:1788636691.610915:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225995264 00000100:00100000:1.0:1788636691.610917:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225995264 00000100:00100000:1.0:1788636691.610926:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225995776 00000100:00100000:1.0:1788636691.610929:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225995776 00000100:00100000:3.0:1788636691.612285:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636691.613774:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225996416 00000100:00100000:3.0:1788636691.613793:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225996416 00000100:00100000:3.0:1788636691.613886:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788636691.613898:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225996416:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636691.616602:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788636691.616619:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225995008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.616735:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521225995008:12345-0@lo:400:kworker.0 Request processed in 120us (10045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636691.616743:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788636691.616759:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788636691.616779:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225995392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.616824:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521225995392:12345-0@lo:400:kworker.0 Request processed in 58us (9592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636691.616838:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788636691.616850:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788636691.616857:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225995904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.616887:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521225995904:12345-0@lo:400:kworker.0 Request processed in 31us (9613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636691.616893:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788636691.616903:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788636691.616910:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225994752:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788636691.618049:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636691.630624:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225996416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 16712us (20136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636691.630646:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1788636691.630754:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef035f6d80 x1875521225996416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636691.630802:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225996416:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788636691.630865:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03657b80 x1875521225996288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636691.630902:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225996288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636691.630921:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521225994752:0@lo:400:kworker.0 00000100:00100000:2.0:1788636691.633118:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788636691.633242:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225995264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636691.633344:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521225995264:12345-0@lo:400:kworker.0 Request processed in 113us (23656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636691.633352:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788636691.633466:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788636691.633476:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225995776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636691.633717:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521225995776:12345-0@lo:400:kworker.0 Request processed in 243us (23993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636691.633724:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788636691.633915:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225994624:0@lo:400:kworker.0 00000100:00100000:2.0:1788636691.633933:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225995136:0@lo:400:kworker.0 00010000:00080000:2.0:1788636691.633947:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03726680 x1875521225995648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636691.633958:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225995648:0@lo:400:kworker.0 00010000:00080000:2.0:1788636691.633971:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef035f7480 x1875521225996160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636691.633979:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225996160:0@lo:400:kworker.0 00000100:00080000:2.0:1788636691.634024:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636691.634030:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636691.634033:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636691.634036:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636691.634101:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225994880:0@lo:400:kworker.0 00010000:00080000:3.0:1788636691.634117:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03725500 x1875521225995392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636691.634127:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521225995392:0@lo:400:kworker.0 00010000:00080000:3.0:1788636691.634140:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03653100 x1875521225995904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636691.634148:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521225995904:0@lo:400:kworker.0 00000100:00100000:3.0:1788636691.634160:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521225995008:0@lo:400:kworker.0 00010000:00080000:3.0:1788636691.634171:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03727800 x1875521225995520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636691.634179:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225995520:0@lo:400:kworker.0 00010000:00080000:3.0:1788636691.634190:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fccf480 x1875521225996032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636691.634198:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225996032:0@lo:400:kworker.0 00000100:00100000:0.0:1788636691.634368:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521225995264:0@lo:400:kworker.0 00000100:00100000:0.0:1788636691.634391:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521225995776:0@lo:400:kworker.0 00000100:00100000:1.0:1788636691.646335:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521225994752:12345-0@lo:400:kworker.0 Request processed in 29414us (36708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636691.646350:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00010000:2.0:1788636691.877404:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788636692.325478:0:13394:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788636692.885184:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636693.910682:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636694.171016:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225996544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636694.171113:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636694.171246:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225996544 00000100:00100000:0.0:1788636694.171256:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225996544 00000100:00100000:0.0:1788636694.171324:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788636694.171334:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225996544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636694.171372:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636694.171429:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521225996544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636694.171436:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788636694.171479:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521225996544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636694.171702:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225996672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636694.171733:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636694.171843:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225996672 00000100:00100000:3.0:1788636694.171849:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225996672 00000100:00100000:3.0:1788636694.171912:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788636694.171921:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225996672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636694.171949:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636694.171988:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225996672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636694.171994:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1788636694.172131:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636694.172156:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef035f6d80 x1875521225996672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636694.172171:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225996672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636694.188196:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225996800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636694.188273:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636694.188522:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225996800 00000100:00100000:3.0:1788636694.188532:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225996800 00000100:00100000:3.0:1788636694.188610:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788636694.188622:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225996800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636694.188644:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788636694.188709:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636694.192880:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225996800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4249us (4596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636694.192897:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:0.0:1788636694.198360:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef023fed80 x1875521225996800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636694.198414:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225996800:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788636694.944749:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636695.194518:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636695.194548:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225996928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636695.194631:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636695.197851:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225996928 00000100:00100000:3.0:1788636695.197867:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225996928 00000100:00100000:3.0:1788636695.197927:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788636695.197937:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225996928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636695.197983:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788636695.198082:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521225996928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636695.198090:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788636695.198171:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521225996928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636695.680098:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636695.680149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636695.680178:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636695.680204:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636695.680280:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636695.680610:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207031040 00000100:00100000:3.0:1788636695.680622:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207031040 00000100:00100000:3.0:1788636695.680687:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207031296 00000100:00100000:3.0:1788636695.680691:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207031296 00000100:00100000:3.0:1788636695.680712:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207030912 00000100:00100000:3.0:1788636695.680715:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207030912 00000100:00100000:3.0:1788636695.680738:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207031168 00000100:00100000:3.0:1788636695.680741:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207031168 00000100:00100000:3.0:1788636695.680757:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 222 00000100:00100000:3.0:1788636695.680767:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207031040:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636695.680903:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207031040:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 137us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636695.680912:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 222 00000100:00100000:3.0:1788636695.680930:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 223 00000100:00100000:3.0:1788636695.680937:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207031296:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636695.680962:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207031296:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 26us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636695.680968:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 223 00000100:00100000:3.0:1788636695.680981:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 224 00000100:00100000:3.0:1788636695.680987:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207030912:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636695.681009:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207030912:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 23us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636695.681016:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 224 00000100:00100000:3.0:1788636695.681026:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 225 00000100:00100000:3.0:1788636695.681032:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207031168:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636695.681053:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207031168:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 22us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636695.681058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 225 00000100:00080000:0.0:1788636695.682439:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636695.682449:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636695.689316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207030784 00000100:00100000:1.0:1788636695.689331:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207030784 00000100:00100000:1.0:1788636695.689410:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 340 00000100:00100000:1.0:1788636695.689421:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207030784:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636695.689517:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207030784:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 98us (9433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636695.689526:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 340 00010000:00010000:3.0:1788636695.957641:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636696.725400:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636696.725422:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225997056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636696.725492:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636696.725556:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636696.725565:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225997184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636696.725591:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636696.725616:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225997056 00000100:00100000:0.0:1788636696.725623:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225997056 00000100:00100000:0.0:1788636696.725668:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225997184 00000100:00100000:0.0:1788636696.725671:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225997184 00000100:00100000:0.0:1788636696.725690:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788636696.725698:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225997056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636696.725744:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636696.725789:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225997056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636696.725797:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788636696.725838:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788636696.725845:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225997184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636696.725854:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636696.725896:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225997184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636696.725903:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1788636696.725919:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788636696.725946:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef023fc380 x1875521225997184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636696.725986:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225997184:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788636696.726017:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef035f5500 x1875521225997056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636696.726028:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225997056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636696.726642:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225997440:0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.726678:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636696.726701:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225997952:0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.726746:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636696.726768:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521225998464:0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.726788:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636696.726827:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788636696.726834:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225997568:0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.726859:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636696.726890:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225998080:0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.726911:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636696.726924:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225998592:0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.726942:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636696.726966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225997440 00000100:00100000:1.0:1788636696.726972:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225997440 00000100:00100000:1.0:1788636696.726998:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225997952 00000100:00100000:1.0:1788636696.727001:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225997952 00000100:00100000:1.0:1788636696.727016:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225998464 00000100:00100000:1.0:1788636696.727019:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225998464 00000100:00100000:1.0:1788636696.727029:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225998080 00000100:00100000:1.0:1788636696.727031:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225998080 00000100:00100000:1.0:1788636696.727041:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225998592 00000100:00100000:1.0:1788636696.727043:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225998592 00000100:00100000:1.0:1788636696.727056:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788636696.727061:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225997440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.727106:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521225997440:12345-0@lo:400:kworker.0 Request processed in 44us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636696.727113:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788636696.727127:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788636696.727133:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225997952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.727181:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521225997952:12345-0@lo:400:kworker.0 Request processed in 48us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636696.727188:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788636696.727200:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788636696.727205:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521225998464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.727398:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225997696:0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.727428:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636696.727442:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225998208:0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.727465:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636696.727489:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788636696.727496:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225997312:0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.727527:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636696.727549:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225997824:0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.727570:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636696.727587:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225998336:0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.727607:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636696.727642:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225998208 00000100:00100000:3.0:1788636696.727647:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225998208 00000100:00100000:3.0:1788636696.727672:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225998336 00000100:00100000:3.0:1788636696.727675:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225998336 00000100:00100000:3.0:1788636696.727693:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788636696.727699:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225998208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.727747:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225998208:12345-0@lo:400:kworker.0 Request processed in 48us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636696.727754:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788636696.727767:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788636696.727774:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225998336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.727799:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225998336:12345-0@lo:400:kworker.0 Request processed in 26us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636696.727824:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788636696.727843:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225997568 00000100:00100000:3.0:1788636696.727854:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225997568 00000100:00100000:3.0:1788636696.727888:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225997824 00000100:00100000:3.0:1788636696.727892:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225997824 00000100:00100000:3.0:1788636696.727905:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788636696.727910:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225997568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.727945:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225997568:12345-0@lo:400:kworker.0 Request processed in 35us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636696.727952:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788636696.727964:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788636696.727970:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225997824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.727995:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521225997824:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636696.728001:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788636696.728040:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225997824:0@lo:400:kworker.0 00010000:00080000:3.0:1788636696.728054:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf002492d80 x1875521225998336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636696.728062:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002492d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521225998336:0@lo:400:kworker.0 00010000:00080000:3.0:1788636696.728071:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf002490a80 x1875521225998208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636696.728078:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225998208:0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.728129:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225997568:0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.728141:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521225997440:0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.728151:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521225997952:0@lo:400:kworker.0 00000100:00100000:3.0:1788636696.728159:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521225998464:0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.728488:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521225998464:12345-0@lo:400:kworker.0 Request processed in 24us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636696.728497:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788636696.728512:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225997696 00000100:00100000:1.0:1788636696.728515:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225997696 00000100:00100000:1.0:1788636696.728532:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788636696.728538:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225998080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.728588:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521225998080:12345-0@lo:400:kworker.0 Request processed in 49us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636696.728594:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788636696.728606:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788636696.728612:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225998592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.728641:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521225998592:12345-0@lo:400:kworker.0 Request processed in 29us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636696.728647:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788636696.728657:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788636696.728663:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225997696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636696.728694:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521225997696:12345-0@lo:400:kworker.0 Request processed in 31us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636696.728699:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788636696.728746:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521225997696:0@lo:400:kworker.0 00000100:00100000:2.0:1788636696.728893:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225997312 00000100:00100000:2.0:1788636696.728897:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225997312 00000100:00100000:2.0:1788636696.728933:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788636696.728940:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225997312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636696.728982:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521225997312:12345-0@lo:400:kworker.0 Request processed in 43us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636696.728988:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788636696.729105:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521225997312:0@lo:400:kworker.0 00010000:00080000:3.0:1788636696.729987:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf002492a00 x1875521225998080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636696.730000:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521225998080:0@lo:400:kworker.0 00010000:00080000:3.0:1788636696.730012:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf002491500 x1875521225998592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636696.730020:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521225998592:0@lo:400:kworker.0 00000100:00080000:0.0:1788636696.730408:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636696.730414:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636696.730417:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636696.991601:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636698.005316:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636699.029384:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636699.287434:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636699.287456:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225998720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636699.287531:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636699.287560:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225998720 00000100:00100000:2.0:1788636699.287568:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225998720 00000100:00080000:0.0:1788636699.287597:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636699.287625:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788636699.287635:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225998720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636699.287666:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636699.287734:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225998720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636699.287742:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788636699.287769:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636699.287783:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225998848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636699.287836:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788636699.288097:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef02712300 x1875521225998720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636699.288119:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225998720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636699.290740:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225998848 00000100:00100000:2.0:1788636699.290750:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225998848 00000100:00100000:2.0:1788636699.290856:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788636699.290866:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225998848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636699.290892:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636699.290994:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521225998848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636699.291003:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788636699.291284:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636699.291365:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225998976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636699.291422:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788636699.291492:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef035f4380 x1875521225998848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636699.291510:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521225998848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636699.291706:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225998976 00000100:00100000:2.0:1788636699.291711:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225998976 00000100:00100000:2.0:1788636699.291748:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788636699.291766:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225998976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636699.291795:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636699.291865:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521225998976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636699.291872:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788636699.291944:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002493800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521225998976:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788636700.062244:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636700.315974:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636700.315998:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225999104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636700.316831:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636700.318085:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225999104 00000100:00100000:0.0:1788636700.318100:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225999104 00000100:00100000:0.0:1788636700.318167:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788636700.318178:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225999104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636700.318214:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788636700.318311:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521225999104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636700.318340:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788636700.318449:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521225999104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636700.801476:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636700.801545:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636700.801718:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636700.801755:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636700.811196:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636700.811243:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207031552 00000100:00100000:2.0:1788636700.811257:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207031552 00000100:00100000:2.0:1788636700.811282:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207031808 00000100:00100000:2.0:1788636700.811285:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207031808 00000100:00100000:2.0:1788636700.811360:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207031680 00000100:00100000:2.0:1788636700.811365:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207031680 00000100:00100000:2.0:1788636700.811393:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 232 00000100:00100000:2.0:1788636700.811405:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207031808:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636700.811502:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207031808:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 100us (9957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636700.811510:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 232 00000100:00100000:2.0:1788636700.811529:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 233 00000100:00100000:2.0:1788636700.811535:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207031680:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636700.811557:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207031680:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 23us (9802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636700.811594:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 233 00000100:00080000:2.0:1788636700.811616:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636700.811621:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636700.812391:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636700.812430:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 234 00000100:00100000:2.0:1788636700.812438:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207031552:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636700.812486:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207031552:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 49us (11380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636700.812493:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 234 00000100:00100000:2.0:1788636700.815584:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207031424 00000100:00100000:2.0:1788636700.815607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207031424 00000100:00100000:2.0:1788636700.815699:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 342 00000100:00100000:2.0:1788636700.815712:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207031424:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636700.815840:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207031424:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 131us (14121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636700.815850:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 342 00000100:00100000:2.0:1788636700.822587:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207031936 00000100:00100000:2.0:1788636700.822612:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207031936 00000100:00100000:2.0:1788636700.822751:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 235 00000100:00100000:2.0:1788636700.823002:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207031936:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636700.823135:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207031936:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 371us (11954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636700.823144:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 235 00000100:00080000:0.0:1788636700.824380:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1788636700.940204:0:13543:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:31:38 (1788636698) === 00010000:00010000:2.0:1788636701.078063:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636701.401970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636701.403147:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207032064 00000100:00100000:0.0:1788636701.403166:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207032064 00000100:00100000:0.0:1788636701.403251:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:0.0:1788636701.403263:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207032064:12345-192.168.202.26@tcp:41:mkdir.0 00000004:00000024:0.0:1788636701.403315:0:13298:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788636701.403535:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207032064:12345-192.168.202.26@tcp:41:mkdir.0 Request processed in 273us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636701.403546:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:1.0:1788636701.429195:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636701.437133:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207032192 00000100:00100000:0.0:1788636701.437160:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207032192 00000100:00100000:0.0:1788636701.437334:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 2 00000100:00100000:0.0:1788636701.437347:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:10502:x1875521207032192:12345-192.168.202.26@tcp:700:mkdir.0 00000100:00100000:0.0:1788636701.437485:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:10502:x1875521207032192:12345-192.168.202.26@tcp:700:mkdir.0 Request processed in 141us (8307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636701.437493:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 2 00000100:00100000:1.0:1788636701.444930:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636701.445111:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207032448 00000100:00100000:0.0:1788636701.445124:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207032448 00000100:00100000:0.0:1788636701.445199:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:0.0:1788636701.445210:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:10502:x1875521207032448:12345-192.168.202.26@tcp:36:mkdir.0 00010000:00010000:0.0:1788636701.445283:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636701.445558:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83822b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ec5 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.445588:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf0029e2f00) 00010000:00010000:0.0:1788636701.445615:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636701.445736:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838389 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.445750:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838389 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.445760:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838389 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.445797:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.445973:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.445986:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447729:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447748:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447757:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636701.447775:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b0e4259 reply state 00000000e11d0405 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447786:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447793:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cf0029e2000) 00010000:00010000:2.0:1788636701.447796:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636701.447800:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788636701.447835:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788636701.447845:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838389 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447852:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838389 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447859:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838389 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447865:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636701.447869:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838389 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447889:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838389 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447901:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef021c6d00) 00010000:00010000:2.0:1788636701.447903:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636701.447907:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838389 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447913:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838389 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636701.447931:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b0e4259 reply state 00000000e11d0405 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447940:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.447946:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cef021c6100) 00010000:00010000:2.0:1788636701.447949:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636701.447951:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788636701.448085:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:10502:x1875521207032448:12345-192.168.202.26@tcp:36:mkdir.0 Request processed in 2872us (3165us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788636701.448094:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:2.0:1788636701.482977:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636701.483103:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207032576 00000100:00100000:0.0:1788636701.483114:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207032576 00000100:00100000:0.0:1788636701.483186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:0.0:1788636701.483199:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:10503:x1875521207032576:12345-192.168.202.26@tcp:101:chmod.0 00010000:00010000:0.0:1788636701.483221:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636701.483245:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e83839e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f58 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.483325:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8383a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.483339:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8383a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.483363:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8383a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636701.483407:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788636701.483411:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636701.483448:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8383a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.483475:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e83839e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f58 expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.483492:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8383a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f58 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636701.483500:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef021c6d00) 00010000:00010000:0.0:1788636701.483503:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636701.483507:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7000, rc 0) 00000100:00100000:0.0:1788636701.483567:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:10503:x1875521207032576:12345-192.168.202.26@tcp:101:chmod.0 Request processed in 371us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636701.483575:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:0.0:1788636701.488844:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.488954:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207032832 00000100:00100000:2.0:1788636701.488965:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207032832 00000100:00100000:2.0:1788636701.489028:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:2.0:1788636701.489043:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:10503:x1875521207032832:12345-192.168.202.26@tcp:36:chmod.0 00010000:00010000:2.0:1788636701.489108:0:13298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636701.489147:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8383a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f58 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.489180:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef021c6d00) 00010000:00010000:2.0:1788636701.489191:0:13298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636701.489217:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.489232:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.489242:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636701.489455:0:13298:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009520196d reply state 00000000d584bc07 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.489467:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.489475:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf0029e2600) 00010000:00010000:2.0:1788636701.489477:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788636701.489480:0:13298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788636701.489488:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788636701.489587:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:10503:x1875521207032832:12345-192.168.202.26@tcp:36:chmod.0 Request processed in 547us (779us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788636701.489595:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:1.0:1788636701.529562:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.530332:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207032960 00000100:00100000:2.0:1788636701.530348:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207032960 00000100:00100000:2.0:1788636701.530427:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:2.0:1788636701.530438:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:10504:x1875521207032960:12345-192.168.202.26@tcp:101:chown.0 00010000:00010000:2.0:1788636701.530480:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636701.530504:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8383b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f5f expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.530580:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8383ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.530596:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8383ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.530607:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8383ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636701.530669:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788636701.530673:0:11089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636701.530714:0:11089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8383ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.530740:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8383b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f5f expref: 11 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.530760:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8383ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f5f expref: 10 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.530769:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf0029e2600) 00010000:00010000:2.0:1788636701.530772:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636701.530776:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1e00, rc 0) 00000100:00100000:2.0:1788636701.530915:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:10504:x1875521207032960:12345-192.168.202.26@tcp:101:chown.0 Request processed in 479us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636701.530923:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:0.0:1788636701.542651:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.542757:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207033088 00000100:00100000:2.0:1788636701.542767:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207033088 00000100:00100000:2.0:1788636701.542849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:2.0:1788636701.542859:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:10504:x1875521207033088:12345-192.168.202.26@tcp:101:chown.0 00010000:00010000:2.0:1788636701.542886:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636701.542910:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8383c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f66 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.542979:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8383c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.542996:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8383c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543008:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8383c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543020:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8383cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543028:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8383cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543034:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8383cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543114:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8383d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543123:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8383d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543149:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8383d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636701.543205:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788636701.543209:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636701.543227:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8383d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543239:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8383c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543245:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8383c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543252:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8383c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543258:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636701.543262:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8383c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543271:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8383c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543282:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf0029e2600) 00010000:00010000:2.0:1788636701.543285:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636701.543289:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8383c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543295:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8383c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543317:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8383cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543325:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8383cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543330:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8383cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543336:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636701.543339:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8383cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543345:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8383cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543352:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cef021c6100) 00010000:00010000:2.0:1788636701.543355:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636701.543358:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8383cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543365:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8383cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543395:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8383c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f66 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543409:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8383d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f66 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.543427:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cf0029e2000) 00010000:00010000:2.0:1788636701.543430:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636701.543432:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0600, rc 0) 00000100:00100000:2.0:1788636701.543492:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:10504:x1875521207033088:12345-192.168.202.26@tcp:101:chown.0 Request processed in 634us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636701.543499:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:1.0:1788636701.547325:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636701.547449:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207033216 00000100:00100000:0.0:1788636701.547461:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207033216 00000100:00100000:0.0:1788636701.547525:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:0.0:1788636701.547536:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:10504:x1875521207033216:12345-192.168.202.26@tcp:900:chown.0 00000100:00100000:0.0:1788636701.547716:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:10504:x1875521207033216:12345-192.168.202.26@tcp:900:chown.0 Request processed in 180us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636701.547745:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:0.0:1788636701.551255:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.551354:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207033472 00000100:00100000:2.0:1788636701.551370:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207033472 00000100:00100000:2.0:1788636701.551448:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:2.0:1788636701.551458:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:10504:x1875521207033472:12345-192.168.202.26@tcp:36:chown.0 00010000:00010000:2.0:1788636701.551514:0:13298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636701.551540:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8383d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f66 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.551566:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cf0029e2000) 00010000:00010000:2.0:1788636701.551572:0:13298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636701.551595:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.551609:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.551618:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636701.557652:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1788636701.557861:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.557881:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.557890:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.557896:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636701.557918:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.557928:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.557952:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cef021c6100) 00010000:00010000:3.0:1788636701.557956:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636701.557961:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.557969:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838390 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558000:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558006:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558012:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558018:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636701.558021:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558027:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558034:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cf0029e2000) 00010000:00010000:3.0:1788636701.558037:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636701.558045:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558051:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838397 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558135:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558142:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558149:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558154:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636701.558157:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558164:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558172:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf0029e2600) 00010000:00010000:3.0:1788636701.558174:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788636701.558178:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.558184:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8383ac lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636701.561298:0:13298:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a75a8bdd reply state 00000000dd1e3c2f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.561353:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.561365:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cf0029e2000) 00010000:00010000:2.0:1788636701.561368:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788636701.561372:0:13298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788636701.561384:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788636701.561477:0:13298:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788636701.561501:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:10504:x1875521207033472:12345-192.168.202.26@tcp:36:chown.0 Request processed in 10040us (10256us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788636701.561510:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 28 00010000:00010000:3.0:1788636701.561588:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.561603:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.561622:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.561629:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636701.561635:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.561646:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.561679:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cf0029e2000) 00010000:00010000:3.0:1788636701.561682:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788636701.561687:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.561695:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8383dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636701.583524:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636701.583608:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207033600 00000100:00100000:0.0:1788636701.583621:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207033600 00000100:00100000:0.0:1788636701.583715:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 29 00000100:00100000:0.0:1788636701.583729:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:10505:x1875521207033600:12345-192.168.202.26@tcp:101:touch.500 00010000:00010000:0.0:1788636701.583756:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636701.583777:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e8383e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f6d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636701.593580:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 9704us 00010000:00010000:3.0:1788636701.633903:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e8383eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.633928:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e8383eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.633941:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e8383eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.633956:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e8383f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.633963:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e8383f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.633978:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e8383f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634121:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e8383f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634129:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e8383f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634136:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e8383f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636701.634182:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788636701.634187:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636701.634222:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e8383f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634235:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e8383eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634241:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e8383eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634247:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e8383eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634252:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000031800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636701.634257:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e8383eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634265:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e8383eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634285:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf0029e2600) 00010000:00010000:3.0:1788636701.634288:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636701.634294:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e8383eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634471:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e8383eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634488:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e8383f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634494:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e8383f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634500:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e8383f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634506:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000031a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636701.634508:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e8383f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634514:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e8383f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634523:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cef0331cc00) 00010000:00010000:3.0:1788636701.634525:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636701.634528:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e8383f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634534:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e8383f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634594:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e8383e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f6d expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634611:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e8383f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f6d expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.634618:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cef0331c700) 00010000:00010000:3.0:1788636701.634620:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788636701.634622:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015991200, rc 0) 00000100:00100000:3.0:1788636701.634967:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:10505:x1875521207033600:12345-192.168.202.26@tcp:101:touch.500 Request processed in 51239us (51450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636701.634976:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 29 00000100:00100000:1.0:1788636701.642855:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.643448:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207033856 00000100:00100000:2.0:1788636701.643459:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207033856 00000100:00100000:2.0:1788636701.643570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 30 00000100:00100000:2.0:1788636701.643582:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:10505:x1875521207033856:12345-192.168.202.26@tcp:101:touch.500 00010000:00010000:2.0:1788636701.643604:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636701.643623:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838400 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f74 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.644917:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838407 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.644935:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838407 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.644947:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838407 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.644976:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.644984:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.644991:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636701.645390:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788636701.645540:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838415 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.645549:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.645556:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838415 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.645587:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838407 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.645594:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838407 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.645601:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838407 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.645607:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636701.645612:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838407 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.645630:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838407 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.645642:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cef0331c700) 00010000:00010000:2.0:1788636701.645645:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636701.645649:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838407 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.647491:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838407 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636701.647532:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030455d28 reply state 00000000ae5a70f5 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.647551:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.647561:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9cf0029e2400) 00010000:00010000:2.0:1788636701.647564:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636701.647569:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788636701.647631:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838400 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f74 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.647649:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838415 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f74 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.647673:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cf0029e2b00) 00010000:00010000:2.0:1788636701.647675:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636701.647678:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0e00, rc 0) 00000100:00100000:2.0:1788636701.648682:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:10505:x1875521207033856:12345-192.168.202.26@tcp:101:touch.500 Request processed in 5094us (5833us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788636701.648709:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 30 00000100:00100000:3.0:1788636701.673177:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636701.673261:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207034112 00000100:00100000:1.0:1788636701.673270:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207034112 00000100:00100000:1.0:1788636701.673350:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 31 00000100:00100000:1.0:1788636701.673361:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:10505:x1875521207034112:12345-192.168.202.26@tcp:36:touch.500 00010000:00010000:1.0:1788636701.673418:0:13298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636701.673444:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838415 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f74 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636701.673474:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cf0029e2b00) 00010000:00010000:1.0:1788636701.673486:0:13298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636701.673543:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636701.673563:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636701.673570:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636701.673672:0:13298:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026c31a22 reply state 00000000dc011990 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636701.673684:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636701.673691:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cf015d06500) 00010000:00010000:1.0:1788636701.673694:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788636701.673697:0:13298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636701.673885:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:10505:x1875521207034112:12345-192.168.202.26@tcp:36:touch.500 Request processed in 525us (725us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788636701.673893:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 31 00000100:00100000:0.0:1788636701.680415:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636701.680516:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207034240 00000100:00100000:3.0:1788636701.680529:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207034240 00000100:00100000:3.0:1788636701.680600:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 32 00000100:00100000:3.0:1788636701.680617:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:10505:x1875521207034240:12345-192.168.202.26@tcp:101:touch.500 00010000:00010000:3.0:1788636701.680646:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636701.680678:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83842a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f7b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.680734:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83842a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f7b expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.680747:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83842a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f7b expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.680802:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cf015d06500) 00010000:00010000:3.0:1788636701.680837:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788636701.680841:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015990400, rc 0) 00000100:00100000:3.0:1788636701.680896:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+12:10505:x1875521207034240:12345-192.168.202.26@tcp:101:touch.500 Request processed in 284us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636701.680903:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 32 00000100:00100000:1.0:1788636701.684349:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.684459:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207034368 00000100:00100000:2.0:1788636701.684470:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207034368 00000100:00100000:2.0:1788636701.684519:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:2.0:1788636701.684527:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875521207034368:12345-192.168.202.26@tcp:8:touch.500 00010000:00080000:2.0:1788636701.684562:0:9845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:2.0:1788636701.684598:0:9845:0:(genops.c:1385:class_connect()) connect: client a3091a46-1ad5-4415-b7a7-5e4bfab40689, cookie 0x5b741ef42e838431 00002000:00100000:2.0:1788636701.684611:0:9845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a3091a46-1ad5-4415-b7a7-5e4bfab40689/ffff9cf03aa7e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788636701.684627:0:9845:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788636701.684712:0:9845:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788636701.684741:0:9845:0:(import.c:65:import_set_state_nolock()) ffff9cf03aa7b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636701.684853:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2397:x1875521207034368:12345-192.168.202.26@tcp:8:touch.500 Request processed in 324us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636701.684861:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:0.0:1788636701.691257:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636701.691617:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207034496 00000100:00100000:3.0:1788636701.691628:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207034496 00000100:00100000:3.0:1788636701.691717:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:3.0:1788636701.691730:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:0:x1875521207034496:12345-192.168.202.26@tcp:2:touch.500 00000100:00080000:0.0:1788636701.692268:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788636701.703082:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1788636701.703098:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000100:00100000:3.0:1788636701.703324:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:0:x1875521207034496:12345-192.168.202.26@tcp:2:touch.500 Request processed in 11590us (12070us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788636701.703343:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:1.0:1788636701.712914:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636701.714692:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207034752 00000100:00100000:3.0:1788636701.714705:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207034752 00000100:00100000:3.0:1788636701.714785:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 2 00000100:00100000:3.0:1788636701.714797:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+12:10505:x1875521207034752:12345-192.168.202.26@tcp:35:touch.500 00000100:00100000:3.0:1788636701.715167:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:10505:x1875521207034752:12345-192.168.202.26@tcp:35:touch.500 Request processed in 371us (2262us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788636701.715176:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 2 00000100:00100000:1.0:1788636701.729577:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.729797:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207034880 00000100:00100000:2.0:1788636701.729857:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207034880 00000100:00100000:2.0:1788636701.729927:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:2.0:1788636701.729939:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:10506:x1875521207034880:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:2.0:1788636701.729967:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636701.729990:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838438 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f82 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.730070:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83843f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.730089:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83843f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.730122:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83843f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636701.730170:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788636701.730174:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636701.730220:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83843f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.730250:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838438 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f82 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.730268:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83843f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f82 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.730277:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cef0331c700) 00010000:00010000:2.0:1788636701.730280:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636701.730283:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0400, rc 0) 00000100:00100000:2.0:1788636701.730355:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:10506:x1875521207034880:12345-192.168.202.26@tcp:101:rm.0 Request processed in 419us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636701.730362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:1.0:1788636701.733893:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.733986:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207035136 00000100:00100000:2.0:1788636701.733996:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207035136 00000100:00100000:2.0:1788636701.734053:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 34 00000100:00100000:2.0:1788636701.734064:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:10506:x1875521207035136:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:2.0:1788636701.734083:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636701.734104:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f89 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636701.734228:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788636701.734369:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838446 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f89 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.734385:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf0029e2600) 00010000:00010000:2.0:1788636701.734388:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636701.734393:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f89 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.734407:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0e00, rc 0) 00000100:00100000:2.0:1788636701.734474:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:10506:x1875521207035136:12345-192.168.202.26@tcp:101:rm.0 Request processed in 412us (591us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788636701.734482:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 34 00000100:00100000:0.0:1788636701.738042:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636701.738111:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207035264 00000100:00100000:3.0:1788636701.738121:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207035264 00000100:00100000:3.0:1788636701.738173:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:3.0:1788636701.738182:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:10506:x1875521207035264:12345-192.168.202.26@tcp:37:rm.0 00000100:00100000:3.0:1788636701.747078:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:10506:x1875521207035264:12345-192.168.202.26@tcp:37:rm.0 Request processed in 8882us (9034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636701.747093:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:1.0:1788636701.763528:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636701.763681:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207035520 00000100:00100000:0.0:1788636701.763697:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207035520 00000100:00100000:0.0:1788636701.763780:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 4 00000100:00100000:0.0:1788636701.763792:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0244cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:10506:x1875521207035520:12345-192.168.202.26@tcp:35:rm.0 00000100:00100000:0.0:1788636701.764156:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0244cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:10506:x1875521207035520:12345-192.168.202.26@tcp:35:rm.0 Request processed in 365us (642us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788636701.764165:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 4 00000100:00100000:1.0:1788636701.774154:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.776249:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207035776 00000100:00100000:2.0:1788636701.776430:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207035776 00000100:00100000:2.0:1788636701.776569:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 35 00000100:00100000:2.0:1788636701.776583:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:10506:x1875521207035776:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:2.0:1788636701.776619:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636701.776650:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f90 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.776851:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83845b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.776869:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83845b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.776899:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83845b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636701.776914:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788636701.777162:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f90 expref: 19 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.777185:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83845b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f90 expref: 18 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.777196:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cef0331c700) 00010000:00010000:2.0:1788636701.777199:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636701.777203:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0600, rc 0) 00000100:00100000:2.0:1788636701.777411:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:10506:x1875521207035776:12345-192.168.202.26@tcp:101:rm.0 Request processed in 830us (3273us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788636701.777420:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 35 00000100:00100000:2.0:1788636701.780775:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636701.780967:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207035904 00000100:00100000:0.0:1788636701.780981:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207035904 00000100:00100000:0.0:1788636701.781065:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 36 00000100:00100000:0.0:1788636701.781077:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:10506:x1875521207035904:12345-192.168.202.26@tcp:41:rm.0 00000004:00000024:0.0:1788636701.781153:0:13298:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788636701.781242:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:10506:x1875521207035904:12345-192.168.202.26@tcp:41:rm.0 Request processed in 166us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636701.781250:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 36 00000100:00100000:0.0:1788636701.783648:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636701.783946:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207036032 00000100:00100000:3.0:1788636701.783958:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207036032 00000100:00100000:3.0:1788636701.784033:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 37 00000100:00100000:3.0:1788636701.784045:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:10506:x1875521207036032:12345-192.168.202.26@tcp:101:rm.0 00010000:00010000:3.0:1788636701.784069:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636701.784096:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838469 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f97 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784179:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838470 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784197:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838470 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784212:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838470 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784224:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e838477 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784232:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e838477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784238:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e838477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784340:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83847e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784365:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83847e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784373:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83847e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636701.784563:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788636701.784568:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636701.784592:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83847e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784608:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83847e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784618:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838470 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784626:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838470 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784633:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838470 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784640:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636701.784645:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838470 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784667:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838470 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784684:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cef0331c700) 00010000:00010000:3.0:1788636701.784688:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636701.784701:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838470 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784709:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838470 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784726:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e838477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784733:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e838477 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784740:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e838477 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784745:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000031a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636701.784747:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e838477 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784753:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e838477 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784770:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9cf0029e2400) 00010000:00010000:3.0:1788636701.784772:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636701.784776:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e838477 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.784783:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e838477 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.785059:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838469 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f97 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.785088:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83847e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f97 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.785097:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cf015d06500) 00010000:00010000:3.0:1788636701.785100:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636701.785102:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000031800, rc 0) 00000100:00100000:3.0:1788636701.785252:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:10506:x1875521207036032:12345-192.168.202.26@tcp:101:rm.0 Request processed in 1208us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636701.785260:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 37 00000100:00100000:0.0:1788636701.789391:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.789548:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207036288 00000100:00100000:2.0:1788636701.789562:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207036288 00000100:00100000:2.0:1788636701.789636:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 38 00000100:00100000:2.0:1788636701.789647:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:10506:x1875521207036288:12345-192.168.202.26@tcp:36:rm.0 00010000:00010000:2.0:1788636701.789730:0:11089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788636701.789775:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83847e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f97 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.789846:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83842a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f7b expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790063:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cf015d06500) 00010000:00010000:2.0:1788636701.790079:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83843f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f82 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790088:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cef0331c700) 00010000:00010000:2.0:1788636701.790092:0:11089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636701.790119:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838485 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790136:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838485 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790148:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838485 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790159:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790167:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790174:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790295:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838493 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790304:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838493 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790323:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838493 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788636701.790614:0:11089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788636701.790625:0:11089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370601817674ns, next at 371601814791ns, rc = 0 00010000:00010000:2.0:1788636701.790691:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790701:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790709:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790717:0:11089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790724:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790731:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790762:0:11089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636701.790783:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838493 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790790:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838493 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.790797:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838493 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.791000:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636701.791009:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.791017:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636701.791022:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.791031:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.791042:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cf015d06500) 00010000:00010000:3.0:1788636701.791045:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788636701.791049:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.791056:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83849a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636701.791069:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636701.791076:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636701.791078:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636701.791132:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636701.791136:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838493 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791143:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838493 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791152:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cf015d06500) 00010000:00010000:2.0:1788636701.791154:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788636701.791157:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838493 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791163:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838493 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791181:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838485 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791187:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838485 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791194:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838485 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791199:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636701.791202:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838485 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791206:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838485 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791224:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cef0331c700) 00010000:00010000:2.0:1788636701.791226:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636701.791229:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838485 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791235:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e838485 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636701.791245:0:11089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002abc7abd reply state 00000000ea58b658 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791257:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.791264:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9cf0029e2400) 00010000:00010000:2.0:1788636701.791266:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636701.791269:0:11089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636701.791369:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:10506:x1875521207036288:12345-192.168.202.26@tcp:36:rm.0 Request processed in 1721us (1992us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788636701.791379:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 38 00000100:00100000:2.0:1788636701.794619:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636701.794700:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207036544 00000100:00100000:0.0:1788636701.794713:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207036544 00000100:00100000:0.0:1788636701.794787:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 5 00000100:00100000:0.0:1788636701.794799:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:10506:x1875521207036544:12345-192.168.202.26@tcp:35:rm.0 00000100:00100000:0.0:1788636701.795101:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:10506:x1875521207036544:12345-192.168.202.26@tcp:35:rm.0 Request processed in 304us (495us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788636701.795109:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 5 00000100:00100000:1.0:1788636701.797880:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636701.798014:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207036800 00000100:00100000:2.0:1788636701.798026:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207036800 00000100:00100000:2.0:1788636701.798102:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 39 00000100:00100000:2.0:1788636701.798114:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:10506:x1875521207036800:12345-192.168.202.26@tcp:36:rm.0 00010000:00010000:2.0:1788636701.798189:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788636701.798223:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83845b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f90 expref: 19 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798274:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e8383f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f6d expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798288:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cef0331c700) 00010000:00010000:2.0:1788636701.798307:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8383ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f5f expref: 17 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798317:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf0029e2600) 00010000:00010000:2.0:1788636701.798325:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636701.798354:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e8384a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798370:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e8384a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798381:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e8384a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798395:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798402:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798409:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798513:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e8384af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798531:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e8384af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.798538:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e8384af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636701.799047:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788636701.799069:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e8384af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799077:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e8384af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799086:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e8384af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799091:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153e000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636701.799097:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e8384af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799107:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e8384af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799117:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9cf0029e2000) 00010000:00010000:2.0:1788636701.799120:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788636701.799124:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e8384af lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799131:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e8384af lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799152:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e8384a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799165:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e8384a1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799171:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e8384a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799177:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153ec00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636701.799180:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e8384a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799186:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e8384a1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799194:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf0029e2a00) 00010000:00010000:2.0:1788636701.799196:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636701.799199:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e8384a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799206:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e8384a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636701.799218:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b398a3e reply state 000000005a8373a7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799229:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636701.799236:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cf0029e2b00) 00010000:00010000:2.0:1788636701.799238:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636701.799241:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636701.799339:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:10506:x1875521207036800:12345-192.168.202.26@tcp:36:rm.0 Request processed in 1225us (1473us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788636701.799354:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 39 00000100:00100000:2.0:1788636701.845238:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636701.845278:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225999232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636701.845379:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636701.845694:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225999232 00000100:00100000:0.0:1788636701.845705:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225999232 00000100:00100000:0.0:1788636701.845787:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788636701.845798:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225999232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636701.845862:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636701.845927:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521225999232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636701.845936:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1788636701.846064:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636701.846153:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225999360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636701.846182:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788636701.846232:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef019b7480 x1875521225999232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636701.846254:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521225999232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636701.846574:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225999872:0@lo:400:kworker.0 00000100:00100000:2.0:1788636701.846607:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636701.846624:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226000384:0@lo:400:kworker.0 00000100:00100000:2.0:1788636701.846650:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636701.846682:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788636701.846688:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225999744:0@lo:400:kworker.0 00000100:00100000:2.0:1788636701.846713:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636701.846727:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226000256:0@lo:400:kworker.0 00000100:00100000:2.0:1788636701.846743:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636701.846757:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226000768:0@lo:400:kworker.0 00000100:00100000:2.0:1788636701.846776:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636701.846799:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226000384 00000100:00100000:2.0:1788636701.846803:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226000384 00000100:00100000:3.0:1788636701.846900:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225999616:0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.846933:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636701.846952:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226000128:0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.846971:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636701.846987:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226000640:0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847007:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636701.847017:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788636701.847022:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225999488:0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847048:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636701.847077:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226000000:0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847098:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636701.847114:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226000512:0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847131:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636701.847159:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225999744 00000100:00100000:3.0:1788636701.847162:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225999744 00000100:00100000:3.0:1788636701.847197:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226000000 00000100:00100000:3.0:1788636701.847199:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226000000 00000100:00100000:3.0:1788636701.847212:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788636701.847220:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225999744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847276:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225999744:12345-0@lo:400:kworker.0 Request processed in 56us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636701.847283:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788636701.847297:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788636701.847302:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226000000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847349:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226000000:12345-0@lo:400:kworker.0 Request processed in 47us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636701.847355:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788636701.847389:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226000000:0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847407:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226000512 00000100:00100000:3.0:1788636701.847410:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226000512 00000100:00100000:3.0:1788636701.847441:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788636701.847447:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226000512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847477:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226000512:12345-0@lo:400:kworker.0 Request processed in 31us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636701.847483:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788636701.847499:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636701.847515:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf040991c00 x1875521226000512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636701.847526:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226000512:0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847545:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225999744:0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847563:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225999872 00000100:00100000:3.0:1788636701.847566:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225999872 00000100:00100000:3.0:1788636701.847585:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226000256 00000100:00100000:3.0:1788636701.847587:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226000256 00000100:00080000:3.0:1788636701.847601:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636701.847610:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226000768 00000100:00100000:3.0:1788636701.847612:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226000768 00000100:00080000:3.0:1788636701.847620:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636701.847630:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225999616 00000100:00100000:3.0:1788636701.847632:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225999616 00000100:00100000:3.0:1788636701.847641:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226000128 00000100:00100000:3.0:1788636701.847648:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226000128 00000100:00080000:3.0:1788636701.847675:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636701.847690:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226000640 00000100:00100000:3.0:1788636701.847693:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226000640 00000100:00080000:3.0:1788636701.847701:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636701.847713:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788636701.847718:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225999872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847751:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521225999872:12345-0@lo:400:kworker.0 Request processed in 33us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636701.847758:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788636701.847779:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521225999872:0@lo:400:kworker.0 00000100:00100000:3.0:1788636701.847794:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788636701.847800:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226000256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636701.848183:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225999488 00000100:00100000:1.0:1788636701.848188:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225999488 00000100:00100000:1.0:1788636701.848222:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788636701.848228:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225999488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636701.848287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521225999488:12345-0@lo:400:kworker.0 Request processed in 59us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636701.848294:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788636701.848327:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521225999488:0@lo:400:kworker.0 00000100:00100000:1.0:1788636701.848354:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788636701.848361:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226000768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636701.848393:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226000768:12345-0@lo:400:kworker.0 Request processed in 34us (1617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636701.848399:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00080000:1.0:1788636701.848423:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03244000 x1875521226000768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636701.848434:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226000768:0@lo:400:kworker.0 00000100:00100000:1.0:1788636701.848449:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788636701.848456:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225999616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636701.848484:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521225999616:12345-0@lo:400:kworker.0 Request processed in 29us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636701.848491:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788636701.848510:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521225999616:0@lo:400:kworker.0 00000100:00100000:1.0:1788636701.848533:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788636701.848539:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226000128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636701.848567:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226000128:12345-0@lo:400:kworker.0 Request processed in 29us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636701.848573:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788636701.848605:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226000128:0@lo:400:kworker.0 00000100:00100000:1.0:1788636701.848619:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788636701.848625:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226000640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636701.848664:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226000640:12345-0@lo:400:kworker.0 Request processed in 28us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636701.848672:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788636701.848694:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040992d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226000640:0@lo:400:kworker.0 00000100:00100000:2.0:1788636701.848935:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788636701.848942:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226000384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636701.848986:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226000384:12345-0@lo:400:kworker.0 Request processed in 44us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636701.848993:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788636701.849209:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636701.849232:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc1f80 x1875521226000384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636701.849243:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226000384:0@lo:400:kworker.0 00000100:00100000:0.0:1788636701.849346:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521225999360 00000100:00100000:0.0:1788636701.849352:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521225999360 00000100:00100000:0.0:1788636701.849398:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788636701.849405:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225999360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636701.849430:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636701.849473:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521225999360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (3290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636701.849478:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788636701.849976:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226000256:12345-0@lo:400:kworker.0 Request processed in 2174us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636701.849985:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00010000:00080000:1.0:1788636701.850121:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc3b80 x1875521226000256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636701.850134:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226000256:0@lo:400:kworker.0 00010000:00080000:1.0:1788636701.850147:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef035f5180 x1875521225999360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636701.850165:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521225999360:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788636701.850740:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788636702.101219:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636703.143276:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636704.152763:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636704.405088:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226000896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636704.405182:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636704.406021:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226000896 00000100:00100000:1.0:1788636704.406029:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226000896 00000100:00100000:1.0:1788636704.406087:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788636704.406098:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226000896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636704.406142:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636704.407759:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226000896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636704.407781:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788636704.407846:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226001024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636704.407910:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788636704.407974:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636704.408017:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef035f7480 x1875521226000896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636704.412480:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226001152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636704.412558:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636704.416973:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226001024 00000100:00100000:3.0:1788636704.416992:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226001024 00000100:00100000:3.0:1788636704.417070:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788636704.417082:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226001024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788636704.417124:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636704.417698:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226001152 00000100:00100000:0.0:1788636704.417704:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226001152 00000100:00100000:0.0:1788636704.417802:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788636704.417825:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226001152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636704.417844:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636704.417906:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226001152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (5346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636704.417913:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1788636704.417957:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03730a80 x1875521226001152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636704.418000:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226001152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636704.418646:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226001024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1565us (10733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636704.418657:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788636704.419527:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226000896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636704.421774:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226001024:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788636704.426512:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788636705.173125:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636705.433432:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636705.433457:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226001280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636705.433532:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636705.435846:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226001280 00000100:00100000:3.0:1788636705.435861:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226001280 00000100:00100000:3.0:1788636705.436026:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788636705.436037:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226001280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636705.436078:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788636705.436173:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226001280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636705.436181:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788636705.436281:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226001280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636705.945736:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636705.945785:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636705.948267:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636705.948362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636705.948388:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636705.948425:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636705.948489:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207037184 00000100:00100000:2.0:1788636705.948501:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207037184 00000100:00100000:2.0:1788636705.948564:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207037440 00000100:00100000:2.0:1788636705.948567:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207037440 00000100:00100000:2.0:1788636705.948581:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207037056 00000100:00100000:2.0:1788636705.948583:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207037056 00000100:00100000:2.0:1788636705.948593:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207037568 00000100:00100000:2.0:1788636705.948595:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207037568 00000100:00100000:2.0:1788636705.948621:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 242 00000100:00100000:2.0:1788636705.948631:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207037184:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636705.948866:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 243 00000100:00100000:1.0:1788636705.948877:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207037440:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636705.948954:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207037440:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 80us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636705.948962:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 243 00000100:00100000:1.0:1788636705.948991:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 244 00000100:00100000:1.0:1788636705.948998:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2401:x1875521207037056:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636705.949027:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2401:x1875521207037056:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 30us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636705.949049:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 244 00000100:00100000:1.0:1788636705.949062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 245 00000100:00100000:1.0:1788636705.949069:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207037568:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636705.949095:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207037568:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 27us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636705.949101:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 245 00000100:00100000:2.0:1788636705.949577:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207037184:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 947us (3791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636705.949585:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 242 00000100:00100000:2.0:1788636705.949624:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207037312 00000100:00100000:2.0:1788636705.949630:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207037312 00000100:00100000:3.0:1788636705.949854:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207036928 00000100:00100000:3.0:1788636705.949859:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207036928 00000100:00100000:3.0:1788636705.949909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 344 00000100:00100000:3.0:1788636705.949917:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207036928:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636705.949948:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207036928:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 31us (4223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636705.949954:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 344 00000100:00080000:3.0:1788636705.949999:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636705.950005:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636705.950796:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 96 00000100:00100000:2.0:1788636705.950850:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207037312:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636705.950894:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207037312:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 48us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636705.950901:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 96 00000100:00080000:3.0:1788636705.956890:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788636706.198006:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636706.965627:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636706.965650:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226001408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636706.965719:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636706.965982:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226001408 00000100:00100000:0.0:1788636706.965991:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226001408 00000100:00100000:0.0:1788636706.966048:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788636706.966058:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226001408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636706.966086:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636706.966159:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226001408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636706.966166:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788636706.966187:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788636706.966214:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcaed80 x1875521226001408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636706.966232:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226001408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636706.968731:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226001792:0@lo:400:kworker.0 00000100:00100000:1.0:1788636706.968796:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636706.968851:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226002304:0@lo:400:kworker.0 00000100:00100000:1.0:1788636706.968872:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636706.968892:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226002816:0@lo:400:kworker.0 00000100:00100000:1.0:1788636706.968911:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636706.968935:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788636706.968941:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226001920:0@lo:400:kworker.0 00000100:00100000:1.0:1788636706.968966:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636706.968985:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226002432:0@lo:400:kworker.0 00000100:00100000:1.0:1788636706.969003:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636706.969017:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226002944:0@lo:400:kworker.0 00000100:00100000:1.0:1788636706.969033:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636706.969058:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226001792 00000100:00100000:1.0:1788636706.969076:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226001792 00000100:00100000:1.0:1788636706.969112:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226002304 00000100:00100000:1.0:1788636706.969115:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226002304 00000100:00100000:1.0:1788636706.969225:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226002816 00000100:00100000:1.0:1788636706.969229:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226002816 00000100:00100000:1.0:1788636706.969244:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226002432 00000100:00100000:1.0:1788636706.969246:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226002432 00000100:00100000:1.0:1788636706.969257:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226002944 00000100:00100000:1.0:1788636706.969259:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226002944 00000100:00100000:1.0:1788636706.969273:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788636706.969280:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226001792:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1788636706.969378:0:9844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375780569782ns, next at 376779491728ns, rc = 0 00000100:00100000:3.0:1788636706.969403:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226001536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636706.969575:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636706.969613:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226002048:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.969636:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636706.969648:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226002560:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.969670:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636706.969688:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226003072:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.969706:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636706.969734:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788636706.969740:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226001664:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.969769:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636706.969791:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226002176:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.969831:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636706.969846:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226002688:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.969865:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636706.969895:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226001920 00000100:00100000:3.0:1788636706.969901:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226001920 00000100:00100000:3.0:1788636706.969928:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226002176 00000100:00100000:3.0:1788636706.969930:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226002176 00000100:00100000:3.0:1788636706.969946:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788636706.969952:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226001920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.969997:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226001920:12345-0@lo:400:kworker.0 Request processed in 45us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636706.970004:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788636706.970021:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788636706.970026:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226002176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.970053:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226002176:12345-0@lo:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636706.970059:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788636706.970074:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226002048 00000100:00100000:3.0:1788636706.970077:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226002048 00000100:00100000:3.0:1788636706.970094:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788636706.970100:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226002304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.970127:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226002304:12345-0@lo:400:kworker.0 Request processed in 28us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636706.970155:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788636706.970168:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788636706.970174:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226002816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.970207:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226002816:12345-0@lo:400:kworker.0 Request processed in 34us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636706.970213:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788636706.970225:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788636706.970231:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226002432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.970259:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226002432:12345-0@lo:400:kworker.0 Request processed in 29us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636706.970264:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788636706.970276:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788636706.970282:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226002944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636706.971535:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788636706.971554:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226002048:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788636706.974339:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636706.974350:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636706.974736:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226001792:12345-0@lo:400:kworker.0 Request processed in 5450us (5933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636706.974750:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788636706.977860:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226002048:12345-0@lo:400:kworker.0 Request processed in 6303us (8213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636706.977875:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788636706.977934:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226002560 00000100:00100000:2.0:1788636706.977944:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226002560 00000100:00100000:2.0:1788636706.977999:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226003072 00000100:00100000:2.0:1788636706.978003:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226003072 00000100:00100000:2.0:1788636706.978027:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226002688 00000100:00100000:2.0:1788636706.978030:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226002688 00000100:00100000:2.0:1788636706.978045:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788636706.978053:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226002560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636706.978102:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226002560:12345-0@lo:400:kworker.0 Request processed in 50us (8431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636706.978108:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788636706.978122:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788636706.978127:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226003072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636706.978154:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226003072:12345-0@lo:400:kworker.0 Request processed in 27us (8446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636706.978159:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788636706.978170:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788636706.978184:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226002688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636706.978215:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226002688:12345-0@lo:400:kworker.0 Request processed in 31us (8348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636706.978221:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788636706.978241:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226001664 00000100:00100000:2.0:1788636706.978246:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226001664 00000100:00100000:2.0:1788636706.978272:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788636706.978279:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226001664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636706.978322:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226001664:12345-0@lo:400:kworker.0 Request processed in 44us (8551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636706.978328:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:0.0:1788636706.978844:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636706.978849:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788636706.980837:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788636706.980856:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788636706.980976:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.980989:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.980998:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981004:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636706.981010:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981018:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981034:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9cf0029e2400) 00010000:00010000:0.0:1788636706.981037:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636706.981042:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981061:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83840e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981081:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981087:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981093:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981098:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636706.981101:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981107:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981113:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9cf015d06500) 00010000:00010000:0.0:1788636706.981116:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636706.981118:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981123:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838423 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981140:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981146:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981157:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981162:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636706.981165:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981171:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981178:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9489e480 (ffff9cf0029e2400) 00010000:00010000:0.0:1788636706.981180:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636706.981183:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981188:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83848c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9489e480 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981202:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981208:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981214:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981218:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636706.981221:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981236:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981244:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cf0029e2b00) 00010000:00010000:0.0:1788636706.981246:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636706.981249:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636706.981255:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e8384a8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636706.982573:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226001536 00000100:00100000:0.0:1788636706.982589:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226001536 00000100:00100000:0.0:1788636706.982656:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788636706.982667:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226001536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636706.982694:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636706.982789:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226001536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (13213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636706.982796:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788636706.983570:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226002944:12345-0@lo:400:kworker.0 Request processed in 13286us (14532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636706.983581:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788636706.983736:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226001664:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.983753:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226002176:0@lo:400:kworker.0 00010000:00080000:3.0:1788636706.983768:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03451f80 x1875521226002688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636706.983778:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226002688:0@lo:400:kworker.0 00010000:00080000:3.0:1788636706.983790:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef035f5180 x1875521226001536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636706.983857:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226001536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636706.983874:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226002048:0@lo:400:kworker.0 00010000:00080000:3.0:1788636706.983886:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03453800 x1875521226002560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636706.983893:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226002560:0@lo:400:kworker.0 00010000:00080000:3.0:1788636706.983902:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03452300 x1875521226003072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636706.983908:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226003072:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.983939:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636706.983949:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226003200:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788636706.983994:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636706.984040:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226001920:0@lo:400:kworker.0 00010000:00080000:3.0:1788636706.984052:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03451500 x1875521226002432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636706.984061:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226002432:0@lo:400:kworker.0 00010000:00080000:3.0:1788636706.984071:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03451180 x1875521226002944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636706.984079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226002944:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.984091:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226001792:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.984102:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226002304:0@lo:400:kworker.0 00000100:00100000:3.0:1788636706.984125:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226002816:0@lo:400:kworker.0 00000100:00100000:2.0:1788636706.984281:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226003200 00000100:00100000:2.0:1788636706.984287:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226003200 00000100:00100000:2.0:1788636706.984335:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788636706.984343:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226003200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788636706.984365:0:9847:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788636706.984405:0:9847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c6e1e, atime: 0x6a9c6e1e, ctime: 0x6a9c6e1e, blocks: 0x0 00010000:00010000:2.0:1788636706.984413:0:9847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047717b18/0x5b741ef42e8384b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636706.984437:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1788636706.984442:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636706.984448:0:9847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047717b18/0x5b741ef42e8384b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636706.984478:0:9847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047717b18/0x5b741ef42e8384b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636706.984489:0:9847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047717b18/0x5b741ef42e8384b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636706.984496:0:9847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047717b18/0x5b741ef42e8384b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636706.984511:0:9847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788636706.984671:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521226003200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 328us (675us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788636706.984677:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788636706.985676:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636706.985686:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047717b18/0x5b741ef42e8384b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636706.985770:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153fc00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636706.985777:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047717b18/0x5b741ef42e8384b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636706.985788:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047717b18/0x5b741ef42e8384b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636706.985925:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf03fcc0e00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788636706.985932:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226003200:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788636706.986003:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047717b18/0x5b741ef42e8384b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636706.986013:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047717b18/0x5b741ef42e8384b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636706.986032:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636706.986034:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636706.986036:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788636707.102945:0:13691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788636707.236084:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636708.245247:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788636709.094039:0:13739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecf5e9530 20000000:00000080:3.0:1788636709.094056:0:13739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cef036af400 uarg=0000000000000000 20000000:01000000:3.0:1788636709.094103:0:13739:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788636709.094110:0:13739:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788636709.094114:0:13739:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788636709.100912:0:13740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788636709.101177:0:13739:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788636709.127652:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788636709.127710:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788636709.127728:0:13739:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788636709.127744:0:13739:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788636709.127765:0:13739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.127785:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e838343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f4a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.127836:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03aab0c00/0x5b741ef42e83834a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f51 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.127844:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e838358 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e838351 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.127851:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e838366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83835f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.127858:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf000031000/0x5b741ef42e838374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83836d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.127864:0:13739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03ab36800/0x5b741ef42e838382 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83837b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.127872:0:13739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.127914:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03ab36800/0x5b741ef42e838382 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83837b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.127929:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf03ab36800/0x5b741ef42e838382 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83837b expref: 23 pid: 6516 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636709.127943:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003328:0@lo:104: 00000100:00100000:0.0:1788636709.128010:0:13739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636709.128070:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf000031000/0x5b741ef42e838374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83836d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.128091:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf000031000/0x5b741ef42e838374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83836d expref: 23 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636709.128101:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003456:0@lo:104: 00010000:00010000:0.0:1788636709.128129:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e838366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83835f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.128138:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e838366 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83835f expref: 23 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636709.128144:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003584:0@lo:104: 00010000:00010000:0.0:1788636709.128167:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e838358 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e838351 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.128174:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e838358 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e838351 expref: 23 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636709.128181:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003712:0@lo:104: 00010000:00010000:0.0:1788636709.128205:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03aab0c00/0x5b741ef42e83834a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f51 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.128215:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03aab0c00/0x5b741ef42e83834a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f51 expref: 12 pid: 6514 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636709.128224:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003840:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636709.128274:0:13739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e838343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f4a expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.128293:0:13739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e838343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f4a expref: 12 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636709.128301:0:13739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003968:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636709.128327:0:13739:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf001676480 going to sleep for 11 seconds 00000100:00100000:1.0:1788636709.128732:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788636709.128756:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636709.128777:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636709.128787:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636709.128797:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226003328 00000100:00100000:1.0:1788636709.128833:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226003328 00000100:00100000:1.0:1788636709.128876:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226003456 00000100:00100000:1.0:1788636709.128879:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226003456 00000100:00100000:1.0:1788636709.128892:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226003584 00000100:00100000:1.0:1788636709.128894:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226003584 00000100:00100000:1.0:1788636709.128904:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226003712 00000100:00100000:1.0:1788636709.128906:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226003712 00000100:00100000:1.0:1788636709.128920:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788636709.128929:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcb2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+6:13739:x1875521226003328:12345-0@lo:104: 00010000:00010000:1.0:1788636709.128946:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129019:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636709.129026:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcb2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+6:13739:x1875521226003328:12345-0@lo:104: Request processed in 98us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636709.129034:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788636709.129074:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788636709.129081:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:13739:x1875521226003456:12345-0@lo:104: 00010000:00010000:1.0:1788636709.129090:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129121:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788636709.129127:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+5:13739:x1875521226003456:12345-0@lo:104: Request processed in 47us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636709.129133:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788636709.129146:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788636709.129151:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:13739:x1875521226003584:12345-0@lo:104: 00010000:00010000:1.0:1788636709.129158:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129189:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788636709.129194:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+4:13739:x1875521226003584:12345-0@lo:104: Request processed in 44us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636709.129200:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788636709.129212:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788636709.129217:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:13739:x1875521226003712:12345-0@lo:104: 00010000:00010000:1.0:1788636709.129224:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129257:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788636709.129263:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+3:13739:x1875521226003712:12345-0@lo:104: Request processed in 46us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636709.129269:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788636709.129400:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788636709.129406:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129414:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636709.129418:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129427:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636709.129434:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636709.129440:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636709.129475:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129481:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636709.129497:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129504:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36600/0x5b741ef42e83837b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838382 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129527:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788636709.129530:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129535:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000030400 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636709.129538:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129546:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636709.129551:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636709.129556:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636709.129569:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129587:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636709.129594:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129599:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf000030400/0x5b741ef42e83836d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838374 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129608:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636709.129611:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129626:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000030a00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636709.129628:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129634:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636709.129641:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636709.129645:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636709.129662:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129668:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636709.129682:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129689:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf000030a00/0x5b741ef42e83835f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838366 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129697:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636709.129699:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129704:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1000 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636709.129707:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129722:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636709.129728:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636709.129732:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636709.129746:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129750:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636709.129756:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129761:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1000/0x5b741ef42e838351 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e838358 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.129774:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636709.129776:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636709.129777:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636709.129799:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226004480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636709.129853:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636709.129883:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636709.129888:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226004352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636709.129909:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636709.130088:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636709.130100:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226004096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636709.130127:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636709.130162:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636709.130168:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226004224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636709.130189:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636709.130209:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226004480 00000100:00100000:3.0:1788636709.130215:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226004480 00010000:00010000:3.0:1788636709.130238:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e838358 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838351 expref: 24 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636709.130254:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226004352 00000100:00100000:3.0:1788636709.130257:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226004352 00010000:00010000:3.0:1788636709.130268:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e838366 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83835f expref: 25 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636709.130278:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226004096 00000100:00100000:3.0:1788636709.130280:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226004096 00010000:00010000:3.0:1788636709.130289:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03ab36800/0x5b741ef42e838382 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83837b expref: 26 pid: 6516 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636709.130298:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226004224 00000100:00100000:3.0:1788636709.130300:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226004224 00010000:00010000:3.0:1788636709.130309:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf000031000/0x5b741ef42e838374 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83836d expref: 27 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636709.130320:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788636709.130326:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+27:3649:x1875521226004480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636709.130337:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636709.130342:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e838358 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e838351 expref: 27 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.130359:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e838358 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e838351 expref: 27 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.130375:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636709.130404:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+27:3649:x1875521226004480:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636709.130411:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788636709.130425:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636709.130431:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+26:3649:x1875521226004352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636709.130438:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636709.130442:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e838366 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83835f expref: 26 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.130450:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e838366 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83835f expref: 26 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.130460:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636709.130480:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+26:3649:x1875521226004352:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636709.130486:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636709.130497:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788636709.130502:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+25:3646:x1875521226004096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636709.130510:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636709.130514:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03ab36800/0x5b741ef42e838382 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83837b expref: 25 pid: 6516 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.130524:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03ab36800/0x5b741ef42e838382 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83837b expref: 25 pid: 6516 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.130539:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636709.130565:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+25:3646:x1875521226004096:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636709.130570:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788636709.130595:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788636709.130602:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521226004224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636709.130609:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636709.130614:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf000031000/0x5b741ef42e838374 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83836d expref: 24 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.130622:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf000031000/0x5b741ef42e838374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83836d expref: 24 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.130632:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636709.130652:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521226004224:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636709.130657:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788636709.130687:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226004224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636709.130695:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226004096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636709.133603:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636709.133711:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab36800/0x5b741ef42e838382 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83837b expref: 23 pid: 6516 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636709.133728:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003328:0@lo:104: 00010000:00010000:2.0:1788636709.133741:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031000/0x5b741ef42e838374 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83836d expref: 22 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636709.133749:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003456:0@lo:104: 00010000:00010000:2.0:1788636709.133774:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e838366 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83835f expref: 21 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636709.133783:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003584:0@lo:104: 00010000:00010000:2.0:1788636709.133792:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e838358 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e838351 expref: 20 pid: 6513 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636709.133799:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003712:0@lo:104: 00000100:00100000:1.0:1788636709.136379:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226004352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636709.136395:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226004480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636709.154261:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636709.154724:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207037696 00000100:00100000:1.0:1788636709.154734:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207037696 00010000:00010000:1.0:1788636709.154770:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03aab0c00/0x5b741ef42e83834a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f51 expref: 13 pid: 6514 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636709.154823:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 50 00000100:00100000:1.0:1788636709.154832:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207037696:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636709.154846:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636709.154852:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03aab0c00/0x5b741ef42e83834a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f51 expref: 13 pid: 6514 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.154864:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03aab0c00/0x5b741ef42e83834a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f51 expref: 13 pid: 6514 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.154884:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636709.154928:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207037696:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 97us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636709.154935:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 50 00000100:00100000:1.0:1788636709.161929:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636709.162061:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207037824 00000100:00100000:3.0:1788636709.162072:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207037824 00010000:00010000:3.0:1788636709.162111:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e838343 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f4a expref: 13 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636709.162167:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 51 00000100:00100000:3.0:1788636709.162178:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207037824:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636709.162205:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636709.162211:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e838343 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f4a expref: 13 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162225:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e838343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f4a expref: 13 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162249:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162258:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162274:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162281:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162288:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162296:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162302:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636709.162306:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162845:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162872:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636709.162885:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636709.162946:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207037824:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 769us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636709.162955:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 51 00010000:00010000:2.0:1788636709.169907:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab0c00/0x5b741ef42e83834a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f51 expref: 12 pid: 6514 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636709.169928:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003840:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636709.170044:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e838343 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f4a expref: 11 pid: 6513 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636709.170055:0:13739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13739:1875521226003968:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636709.170091:0:13739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.170102:0:13739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.170109:0:13739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636709.170115:0:13739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8384bd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636709.292214:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636709.533078:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636709.533102:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226004608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636709.533187:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636709.533252:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226004608 00000100:00100000:2.0:1788636709.533260:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226004608 00000100:00100000:2.0:1788636709.533331:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788636709.533342:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226004608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636709.533372:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636709.533417:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226004608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636709.533424:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788636709.533443:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636709.533472:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03656300 x1875521226004608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636709.533490:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226004608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636709.542161:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226004736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636709.542267:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636709.542360:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226004736 00000100:00100000:3.0:1788636709.542367:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226004736 00000100:00100000:3.0:1788636709.542669:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788636709.542679:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226004736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636709.542702:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636709.542749:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226004736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636709.542756:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1788636709.542778:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636709.542823:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03656300 x1875521226004736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636709.542856:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226004736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636709.550073:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636709.550095:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226004864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636709.550183:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636709.550240:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226004864 00000100:00100000:1.0:1788636709.550249:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226004864 00000100:00100000:1.0:1788636709.550303:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788636709.550324:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226004864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788636709.550372:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788636709.550431:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226004864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636709.550438:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788636709.550485:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226004864:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788636710.293975:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636710.560512:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636710.560538:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226004992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636710.562056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636710.562863:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226004992 00000100:00100000:0.0:1788636710.562873:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226004992 00000100:00100000:0.0:1788636710.562929:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788636710.562939:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226004992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636710.562977:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788636710.563044:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226004992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636710.563052:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788636710.563299:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226004992:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1788636710.727141:0:13789:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff77a397b0 20000000:00000080:2.0:1788636710.727160:0:13789:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf03fca9000 uarg=0000000000000000 20000000:01000000:2.0:1788636710.727205:0:13789:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788636710.727212:0:13789:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788636710.727217:0:13789:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1788636710.728303:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788636710.729063:0:13789:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788636710.729147:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788636710.729175:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788636710.729189:0:13789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788636710.729201:0:13789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788636710.729221:0:13789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.729237:0:13789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.729248:0:13789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.729254:0:13789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.729260:0:13789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.729267:0:13789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.729273:0:13789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153e200 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636710.729277:0:13789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.729297:0:13789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.729546:0:13789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.729565:0:13789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.729572:0:13789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153e200/0x5b741ef42e8384c4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636710.937623:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636710.937632:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf03a765800 from 7 10000000:01000000:2.0:1788636710.937637:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636710.937705:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.937717:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.937729:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636710.937761:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226005120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.937895:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636710.937951:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788636710.938036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226005120 00000100:00100000:3.0:1788636710.938047:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226005120 00000100:00100000:3.0:1788636710.938113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788636710.938124:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+20:6519:x1875521226005120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636710.938136:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636710.938150:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf000031000/0x5b741ef42e8384d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8384cb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636710.938173:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf000031000/0x5b741ef42e8384d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8384cb expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636710.938183:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf000031000/0x5b741ef42e8384d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8384cb expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636710.938201:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000031000, rc 0) 00000100:00100000:3.0:1788636710.938244:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521226005120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636710.938250:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788636710.938762:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226005120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636710.938779:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636710.938789:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636710.938894:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226005248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636710.938927:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636710.938955:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0321b0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.939065:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226005248 00000100:00100000:2.0:1788636710.939069:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226005248 00000100:00100000:2.0:1788636710.939097:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788636710.939117:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521226005248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.939235:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521226005248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.939242:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788636710.939275:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226005248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.939303:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226005376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.939340:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636710.939353:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.939375:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226005376 00000100:00100000:2.0:1788636710.939385:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226005376 00000100:00100000:2.0:1788636710.939406:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788636710.939413:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521226005376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.939492:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521226005376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.939498:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788636710.939537:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226005376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.939741:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13798:1875521226005504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636710.939772:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636710.939790:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226005504 00000100:00100000:2.0:1788636710.939793:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226005504 00000100:00100000:2.0:1788636710.939832:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788636710.939838:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:13798:x1875521226005504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636710.939904:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:13798:x1875521226005504:12345-0@lo:502:llog_process_th.0 Request processed in 65us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.939918:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788636710.939943:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.939954:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13798:1875521226005504:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636710.939974:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636710.939983:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636710.939986:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788636710.939992:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf03a765800 00000020:00000080:2.0:1788636710.939994:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788636710.940045:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636710.940049:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636710.940050:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788636710.940052:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636710.940054:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636710.940056:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788636710.940059:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf03a765800 00000020:00000080:2.0:1788636710.940061:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788636710.940091:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13798:1875521226005632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636710.940124:0:13798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636710.940142:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226005632 00000100:00100000:2.0:1788636710.940145:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226005632 00000100:00100000:2.0:1788636710.940164:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788636710.940170:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:13798:x1875521226005632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636710.940224:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:13798:x1875521226005632:12345-0@lo:502:llog_process_th.0 Request processed in 54us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.940231:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788636710.940257:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.940268:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13798:1875521226005632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636710.940292:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636710.940296:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636710.940298:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788636710.940301:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788636710.940357:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788636710.940376:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636710.940385:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.940396:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636710.940406:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636710.940408:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00f1a3000 from 7 10000000:01000000:2.0:1788636710.940410:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636710.940432:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.940439:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.940448:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636710.940460:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226005760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.940487:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636710.940501:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.940512:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226005760 00000100:00100000:2.0:1788636710.940515:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226005760 00000100:00100000:2.0:1788636710.940534:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788636710.940546:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:6519:x1875521226005760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636710.940572:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636710.940584:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e8384e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8384d9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.940605:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e8384e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8384d9 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.940615:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e8384e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8384d9 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.940623:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153fc00, rc 0) 00000100:00100000:2.0:1788636710.940652:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521226005760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.940658:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788636710.940686:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226005760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636710.940697:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.940706:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636710.940742:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226005888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.940766:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636710.940778:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.940788:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226005888 00000100:00100000:2.0:1788636710.940791:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226005888 00000100:00100000:2.0:1788636710.940833:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788636710.940847:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521226005888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.940926:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521226005888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.940933:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788636710.940962:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226005888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.940988:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226006016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.941020:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636710.941033:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.941043:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226006016 00000100:00100000:2.0:1788636710.941047:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226006016 00000100:00100000:2.0:1788636710.941066:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788636710.941072:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521226006016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.941127:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521226006016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.941134:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788636710.941167:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226006016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636710.951242:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13799:1875521226006144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636710.951486:0:13799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636710.951534:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef03692a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.956213:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226006144 00000100:00100000:2.0:1788636710.956242:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226006144 00000100:00100000:2.0:1788636710.956334:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788636710.956346:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:13799:x1875521226006144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636710.956606:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:13799:x1875521226006144:12345-0@lo:502:llog_process_th.0 Request processed in 260us (5120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.956615:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788636710.957613:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13799:1875521226006144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636710.957663:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636710.957674:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636710.957677:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788636710.957684:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf00f1a3000 00000020:00000080:1.0:1788636710.957687:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788636710.957751:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636710.958124:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636710.958126:0:13799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788636710.958131:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636710.958134:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636710.958135:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788636710.958140:0:13799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf00f1a3000 00000020:00000080:1.0:1788636710.958142:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788636710.958658:0:13799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13799:1875521226006272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636710.958741:0:13799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636710.958790:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226006272 00000100:00100000:1.0:1788636710.958796:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226006272 00000100:00100000:1.0:1788636710.958858:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788636710.958866:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:13799:x1875521226006272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636710.958995:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:13799:x1875521226006272:12345-0@lo:502:llog_process_th.0 Request processed in 129us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636710.959009:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788636710.959054:0:13799:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef03692a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636710.959073:0:13799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13799:1875521226006272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636710.959095:0:13799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636710.959100:0:13799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636710.959103:0:13799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788636710.959107:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788636710.962400:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788636710.962464:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636710.962480:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.962496:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636710.962509:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636710.962511:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00f150000 from 7 10000000:01000000:2.0:1788636710.962514:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636710.962580:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.962590:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.962605:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636710.962638:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226006400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.962734:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636710.962787:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.962827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226006400 00000100:00100000:2.0:1788636710.962834:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226006400 00000100:00100000:2.0:1788636710.962887:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788636710.962896:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:6519:x1875521226006400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636710.962908:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636710.962921:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf00153e400/0x5b741ef42e8384ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8384e7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.962960:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf00153e400/0x5b741ef42e8384ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8384e7 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.962970:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf00153e400/0x5b741ef42e8384ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8384e7 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.962979:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e400, rc 0) 00000100:00100000:2.0:1788636710.963016:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521226006400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.963023:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788636710.963068:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226006400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636710.963085:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636710.963095:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636710.963149:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226006528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.963175:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636710.963188:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.963198:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226006528 00000100:00100000:2.0:1788636710.963201:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226006528 00000100:00100000:2.0:1788636710.963216:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788636710.963221:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521226006528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.963321:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521226006528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.963347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788636710.963375:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226006528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.963400:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226006656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.963436:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636710.963448:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636710.963458:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226006656 00000100:00100000:2.0:1788636710.963461:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226006656 00000100:00100000:2.0:1788636710.963478:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788636710.963483:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521226006656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636710.963567:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521226006656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636710.963573:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788636710.963612:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226006656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636710.972591:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13803:1875521226006784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636710.972691:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636710.972734:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aac29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636710.975652:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226006784 00000100:00100000:3.0:1788636710.975672:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226006784 00000100:00100000:3.0:1788636710.975752:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788636710.975763:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:13803:x1875521226006784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636710.976002:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:13803:x1875521226006784:12345-0@lo:502:llog_process_th.0 Request processed in 240us (3311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636710.976022:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788636710.976109:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13803:1875521226006784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788636710.976151:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636710.976162:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636710.976165:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788636710.976173:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf00f150000 00000020:00000080:3.0:1788636710.976175:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636710.976269:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636710.976273:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636710.976274:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788636710.976277:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636710.976279:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636710.976281:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788636710.976284:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf00f150000 00000020:00000080:3.0:1788636710.976286:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788636710.976340:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13803:1875521226006912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636710.976602:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636710.976633:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226006912 00000100:00100000:3.0:1788636710.976639:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226006912 00000100:00100000:3.0:1788636710.976664:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788636710.976671:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:13803:x1875521226006912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636710.976753:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:13803:x1875521226006912:12345-0@lo:502:llog_process_th.0 Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636710.976760:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788636710.976837:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aac29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636710.976849:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13803:1875521226006912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788636710.976867:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636710.976876:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636710.976878:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788636710.976881:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788636710.976957:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788636710.976977:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636710.976989:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636710.977000:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636710.977012:0:6519:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788636710.977014:0:6519:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00324c000 from 7 10000000:01000000:3.0:1788636710.977017:0:6519:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636710.977046:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636710.977055:0:6519:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636710.977065:0:6519:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636710.977081:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226007040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636710.977112:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636710.977129:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf02442ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636710.977140:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226007040 00000100:00100000:3.0:1788636710.977143:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226007040 00000100:00100000:3.0:1788636710.977163:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788636710.977169:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:6519:x1875521226007040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636710.977177:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636710.977195:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8384fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8384f5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636710.977218:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8384fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8384f5 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636710.977229:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8384fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8384f5 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636710.980611:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000030a00, rc 0) 00000100:00100000:3.0:1788636710.980719:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521226007040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3545us (3601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636710.980728:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788636710.980831:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226007040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636710.980859:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636710.980871:0:6519:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636710.980965:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226007168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636710.980998:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636710.981034:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf02442ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636710.981226:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226007168 00000100:00100000:1.0:1788636710.981246:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226007168 00000100:00100000:0.0:1788636711.000687:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788636711.000713:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521226007168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636711.000938:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521226007168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (19937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636711.000945:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788636711.007929:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226007168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636711.007992:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226007296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636711.008058:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636711.008093:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636711.008112:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226007296 00000100:00100000:2.0:1788636711.008118:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226007296 00000100:00100000:2.0:1788636711.008169:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788636711.008178:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521226007296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636711.008296:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:6519:x1875521226007296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636711.008331:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788636711.008549:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:6519:1875521226007296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788636711.014531:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788636711.016296:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13806:1875521226007424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636711.016907:0:13806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636711.016952:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226007424 00000100:00100000:1.0:1788636711.016959:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226007424 00000100:00100000:1.0:1788636711.017013:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788636711.017024:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:13806:x1875521226007424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636711.017147:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:13806:x1875521226007424:12345-0@lo:502:llog_process_th.0 Request processed in 124us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636711.017155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788636711.017206:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef03692780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636711.017228:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13806:1875521226007424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636711.017255:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636711.017264:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636711.017266:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788636711.017274:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf00324c000 00000020:00000080:1.0:1788636711.017277:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788636711.022726:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636711.022748:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636711.022751:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788636711.022755:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636711.022759:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636711.022760:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788636711.022765:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf00324c000 00000020:00000080:1.0:1788636711.022768:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788636711.022872:0:13806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13806:1875521226007552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636711.022952:0:13806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636711.022992:0:13806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef03692780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636711.023659:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226007552 00000100:00100000:3.0:1788636711.023667:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226007552 00000100:00100000:3.0:1788636711.023718:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788636711.023728:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:13806:x1875521226007552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636711.023873:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:13806:x1875521226007552:12345-0@lo:502:llog_process_th.0 Request processed in 146us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636711.023888:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788636711.031906:0:13806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:13806:1875521226007552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636711.031958:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636711.031967:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636711.031969:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788636711.031973:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788636711.036166:0:6519:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788636711.036208:0:6519:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636711.036220:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636711.036234:0:6519:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636711.062980:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636711.063027:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636711.063057:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207038336 00000100:00100000:0.0:1788636711.063067:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207038336 00000100:00100000:0.0:1788636711.063135:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 100 00000100:00100000:0.0:1788636711.063146:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207038336:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636711.063216:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207038336:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 73us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636711.063233:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 100 00000100:00080000:0.0:1788636711.063255:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636711.063286:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636711.063474:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207038080 00000100:00100000:1.0:1788636711.063479:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207038080 00000100:00100000:1.0:1788636711.063510:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207038592 00000100:00100000:1.0:1788636711.063512:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207038592 00000100:00100000:1.0:1788636711.063530:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 252 00000100:00100000:1.0:1788636711.063537:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207038080:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636711.063579:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207038080:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 42us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636711.063584:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 252 00000100:00100000:1.0:1788636711.063596:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 253 00000100:00100000:1.0:1788636711.063602:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207038592:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636711.063623:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207038592:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 22us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636711.063628:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 253 00000100:00100000:0.0:1788636711.064522:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636711.064576:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636711.064658:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636711.064682:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207038208 00000100:00100000:0.0:1788636711.064688:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207038208 00000100:00100000:0.0:1788636711.064720:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207038464 00000100:00100000:0.0:1788636711.064723:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207038464 00000100:00100000:0.0:1788636711.064744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 254 00000100:00100000:0.0:1788636711.064752:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207038208:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636711.064797:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207038208:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 46us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636711.064804:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 254 00000100:00100000:0.0:1788636711.064834:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 255 00000100:00100000:0.0:1788636711.064840:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207038464:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636711.064867:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207038464:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 27us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636711.064873:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 255 00000100:00080000:0.0:1788636711.064925:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636711.064929:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636711.066838:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207037952 00000100:00100000:1.0:1788636711.066854:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207037952 00000100:00100000:1.0:1788636711.066911:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 366 00000100:00100000:1.0:1788636711.066922:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+11:2400:x1875521207037952:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636711.067004:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+11:2400:x1875521207037952:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 84us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636711.067011:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 366 00000040:00080000:1.0:1788636711.069716:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788636711.170856:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636711.170902:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207038720 00000100:00100000:1.0:1788636711.170914:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207038720 00000100:00100000:1.0:1788636711.170971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 367 00000100:00100000:1.0:1788636711.170982:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+11:6174:x1875521207038720:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636711.171004:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636711.171030:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab37c00/0x5b741ef42e838503 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38f9e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636711.171069:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab37c00/0x5b741ef42e838503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f9e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636711.171082:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab37c00/0x5b741ef42e838503 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f9e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636711.171092:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37c00, rc 0) 00000100:00100000:1.0:1788636711.171197:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207038720:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 Request processed in 216us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636711.171204:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 367 00000100:00100000:1.0:1788636711.182793:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636711.182857:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207038848 00000100:00100000:1.0:1788636711.182867:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207038848 00000100:00100000:1.0:1788636711.182922:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 368 00000100:00100000:1.0:1788636711.182945:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207038848:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636711.183137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207038848:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 Request processed in 192us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636711.183146:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 368 00000100:00100000:1.0:1788636711.189654:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636711.189700:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207038976 00000100:00100000:1.0:1788636711.189712:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207038976 00000100:00100000:1.0:1788636711.189767:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 369 00000100:00100000:1.0:1788636711.189778:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207038976:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636711.189943:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207038976:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 Request processed in 167us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636711.189951:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 369 00000100:00100000:3.0:1788636711.200877:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636711.200912:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207039104 00000100:00100000:3.0:1788636711.200923:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207039104 00000100:00100000:3.0:1788636711.200973:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 370 00000100:00100000:3.0:1788636711.200982:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+12:10791:x1875521207039104:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636711.201146:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+12:10791:x1875521207039104:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 164us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636711.201155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 370 00000100:00100000:2.0:1788636711.208580:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636711.208651:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207039232 00000100:00100000:3.0:1788636711.208661:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207039232 00000100:00100000:3.0:1788636711.208716:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 371 00000100:00100000:3.0:1788636711.208729:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+12:10791:x1875521207039232:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636711.208895:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+12:10791:x1875521207039232:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 168us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636711.208904:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 371 00000100:00100000:3.0:1788636711.218838:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636711.218887:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207039360 00000100:00100000:3.0:1788636711.218915:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207039360 00000100:00100000:3.0:1788636711.218969:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 372 00000100:00100000:3.0:1788636711.218981:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+12:6174:x1875521207039360:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636711.219002:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636711.219021:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf000030400/0x5b741ef42e83850a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38fa5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636711.219049:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf000030400/0x5b741ef42e83850a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fa5 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636711.219059:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf000030400/0x5b741ef42e83850a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fa5 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636711.219068:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000030400, rc 0) 00000100:00100000:3.0:1788636711.219191:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:6174:x1875521207039360:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 Request processed in 212us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636711.219198:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 372 00000100:00100000:3.0:1788636711.243047:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636711.246576:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207039488 00000100:00100000:3.0:1788636711.246596:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207039488 00000100:00100000:3.0:1788636711.246750:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 373 00000100:00100000:3.0:1788636711.246763:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:6174:x1875521207039488:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636711.247012:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:6174:x1875521207039488:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 Request processed in 252us (3974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636711.247021:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 373 00000100:00100000:0.0:1788636711.269521:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636711.269600:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207039616 00000100:00100000:1.0:1788636711.269611:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207039616 00000100:00100000:1.0:1788636711.269676:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 374 00000100:00100000:1.0:1788636711.269687:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:6174:x1875521207039616:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636711.269859:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:6174:x1875521207039616:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 Request processed in 172us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636711.269867:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 374 00000100:00100000:1.0:1788636711.281077:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636711.288415:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207039744 00000100:00100000:3.0:1788636711.288434:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207039744 00000100:00100000:3.0:1788636711.288536:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 375 00000100:00100000:3.0:1788636711.288547:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf024536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:10794:x1875521207039744:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636711.288730:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf024536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:10794:x1875521207039744:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 184us (7663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636711.288738:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 375 00000100:00100000:3.0:1788636711.298796:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636711.298859:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207039872 00000100:00100000:3.0:1788636711.298869:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207039872 00000100:00100000:3.0:1788636711.298927:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 376 00000100:00100000:3.0:1788636711.298939:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:10794:x1875521207039872:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636711.299133:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:10794:x1875521207039872:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 195us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636711.299141:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 376 00010000:00010000:2.0:1788636711.328898:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788636712.021952:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788636712.085145:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226007680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636712.085219:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636712.085309:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226007680 00000100:00100000:1.0:1788636712.085317:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226007680 00000100:00100000:1.0:1788636712.085371:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788636712.085396:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226007680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636712.085425:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636712.085468:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226007680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636712.085474:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1788636712.085493:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636712.085537:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226007680:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788636712.086337:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788636712.088688:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521226007936:0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.088688:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226007808:0@lo:400:kworker.0 00000100:00100000:2.0:1788636712.088847:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226008064:0@lo:400:kworker.0 00000100:00100000:1.0:1788636712.088972:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226008192:0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.096988:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636712.097066:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226008320:0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.097103:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636712.097123:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226008832:0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.097148:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636712.097178:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226009344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636712.097204:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636712.097636:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226008320 00000100:00100000:0.0:1788636712.097645:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226008320 00000100:00100000:0.0:1788636712.097694:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788636712.097703:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226008320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.097759:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226008320:12345-0@lo:400:kworker.0 Request processed in 57us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636712.097766:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788636712.097787:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226008832 00000100:00100000:0.0:1788636712.097791:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226008832 00000100:00100000:0.0:1788636712.097852:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788636712.097858:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226008832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.097889:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226008832:12345-0@lo:400:kworker.0 Request processed in 31us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636712.097894:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788636712.097909:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226009344 00000100:00100000:0.0:1788636712.097912:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226009344 00000100:00100000:0.0:1788636712.097938:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788636712.097943:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226009344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636712.097958:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636712.097986:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226009344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636712.098000:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788636712.098054:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636712.098058:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636712.098097:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226009344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636712.098108:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226008320:0@lo:400:kworker.0 00010000:00080000:0.0:1788636712.098120:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bd180 x1875521226008832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636712.098129:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226008832:0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.098171:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226007808 00000100:00100000:0.0:1788636712.098175:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226007808 00000100:00100000:0.0:1788636712.098202:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788636712.098207:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521226007808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.098242:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521226007808:12345-0@lo:400:kworker.0 Request processed in 35us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636712.098249:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788636712.098284:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226007808:0@lo:400:kworker.0 00000100:00100000:2.0:1788636712.102858:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636712.102897:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226008064 00000100:00100000:2.0:1788636712.102904:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226008064 00000100:00100000:2.0:1788636712.102945:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788636712.102953:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226008064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636712.102999:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226008064:12345-0@lo:400:kworker.0 Request processed in 48us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636712.103006:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788636712.103044:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226008064:0@lo:400:kworker.0 00000100:00100000:2.0:1788636712.103056:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226008576:0@lo:400:kworker.0 00000100:00100000:2.0:1788636712.103136:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636712.103156:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226009088:0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.103185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226008576 00000100:00100000:0.0:1788636712.103189:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226008576 00000100:00100000:2.0:1788636712.103193:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636712.103222:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226009088 00000100:00100000:0.0:1788636712.103225:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226009088 00000100:00100000:0.0:1788636712.104459:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788636712.104478:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226008576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.104558:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226008576:12345-0@lo:400:kworker.0 Request processed in 89us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636712.104566:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788636712.104599:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788636712.104606:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226009088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.104640:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226009088:12345-0@lo:400:kworker.0 Request processed in 35us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636712.104646:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00010000:00080000:2.0:1788636712.104875:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bf800 x1875521226008576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636712.104888:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226008576:0@lo:400:kworker.0 00010000:00080000:2.0:1788636712.104897:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bdf80 x1875521226009088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636712.104904:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226009088:0@lo:400:kworker.0 00000100:00080000:2.0:1788636712.104945:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636712.115255:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636712.115323:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226008448:0@lo:400:kworker.0 00000100:00100000:3.0:1788636712.115718:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636712.115743:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226008960:0@lo:400:kworker.0 00000100:00100000:3.0:1788636712.115767:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636712.115842:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226007936 00000100:00100000:3.0:1788636712.115850:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226007936 00000100:00100000:3.0:1788636712.115896:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226008448 00000100:00100000:3.0:1788636712.115900:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226008448 00000100:00100000:3.0:1788636712.115923:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226008960 00000100:00100000:3.0:1788636712.115926:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226008960 00000100:00100000:3.0:1788636712.115962:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788636712.115970:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521226007936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636712.116029:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521226007936:12345-0@lo:400:kworker.0 Request processed in 59us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636712.116036:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788636712.116053:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788636712.116060:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226008448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636712.116087:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226008448:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636712.116093:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788636712.116105:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788636712.116111:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226008960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636712.116153:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226008960:12345-0@lo:400:kworker.0 Request processed in 42us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636712.116159:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:3.0:1788636712.116181:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636712.116225:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521226007936:0@lo:400:kworker.0 00000100:00100000:3.0:1788636712.120003:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226008448:0@lo:400:kworker.0 00000100:00100000:3.0:1788636712.120041:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226008960:0@lo:400:kworker.0 00000100:00100000:1.0:1788636712.120903:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636712.120957:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226008704:0@lo:400:kworker.0 00000100:00100000:1.0:1788636712.120992:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636712.121010:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226009216:0@lo:400:kworker.0 00000100:00100000:1.0:1788636712.121031:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636712.121128:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226008704 00000100:00100000:0.0:1788636712.121136:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226008704 00000100:00100000:0.0:1788636712.121204:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226009216 00000100:00100000:0.0:1788636712.121208:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226009216 00000100:00100000:0.0:1788636712.121227:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788636712.121252:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226008704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.121305:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226008704:12345-0@lo:400:kworker.0 Request processed in 71us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636712.121312:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788636712.121328:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788636712.121334:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226009216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.121361:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226009216:12345-0@lo:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636712.121378:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788636712.121402:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226008192 00000100:00100000:0.0:1788636712.121406:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226008192 00000100:00100000:0.0:1788636712.121433:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788636712.121440:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226008192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636712.121470:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226008192:12345-0@lo:400:kworker.0 Request processed in 31us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636712.121476:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:1.0:1788636712.124429:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636712.124487:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226008192:0@lo:400:kworker.0 00010000:00080000:1.0:1788636712.124504:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033be680 x1875521226008704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636712.124514:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226008704:0@lo:400:kworker.0 00000100:00100000:1.0:1788636712.124525:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226009216:0@lo:400:kworker.0 00010000:00010000:1.0:1788636712.342786:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788636713.118979:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788636713.120748:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:2.0:1788636713.365087:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636714.389160:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636714.644977:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636714.645005:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226009472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636714.645101:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636714.645169:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226009472 00000100:00100000:1.0:1788636714.645178:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226009472 00000100:00100000:1.0:1788636714.645237:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788636714.645259:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226009472:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636714.645309:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226009728:0@lo:13:osp-pre-0-1.0 00000004:00000024:1.0:1788636714.645318:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636714.645343:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636714.645403:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226009728 00000100:00100000:3.0:1788636714.645409:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226009728 00000100:00100000:3.0:1788636714.645443:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788636714.645458:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226009728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636714.645477:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636714.645572:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636714.645594:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226009600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788636714.652508:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636714.653159:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226009728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7697us (7808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636714.653174:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1788636714.653280:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bf800 x1875521226009728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636714.653306:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226009728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636714.653832:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226009472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8583us (8728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636714.653843:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788636714.654070:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636714.654586:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226009600 00000100:00100000:1.0:1788636714.655073:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226009600 00000100:00100000:1.0:1788636714.655149:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788636714.655159:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226009600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636714.655183:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636714.655232:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226009600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636714.655238:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788636714.655313:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636714.656001:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bdf80 x1875521226009600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636714.656034:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226009600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636714.656752:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226009472:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788636715.413376:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636715.670845:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226009856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636715.670920:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636715.671061:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226009856 00000100:00100000:3.0:1788636715.671070:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226009856 00000100:00100000:3.0:1788636715.671122:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788636715.671131:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226009856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636715.671164:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788636715.671216:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226009856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636715.671223:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788636715.671496:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226009856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636716.157604:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636716.157658:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636716.157692:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636716.157736:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636716.157755:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636716.157778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636716.157937:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207040128 00000100:00100000:1.0:1788636716.157948:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207040128 00000100:00100000:1.0:1788636716.158024:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207040640 00000100:00100000:1.0:1788636716.158027:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207040640 00000100:00100000:1.0:1788636716.158042:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207040256 00000100:00100000:1.0:1788636716.158045:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207040256 00000100:00100000:1.0:1788636716.158055:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207040512 00000100:00100000:1.0:1788636716.158057:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207040512 00000100:00100000:1.0:1788636716.158073:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 262 00000100:00100000:1.0:1788636716.158082:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207040128:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636716.158157:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207040128:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 75us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636716.158165:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 262 00000100:00100000:1.0:1788636716.158198:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 263 00000100:00100000:1.0:1788636716.158204:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207040640:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636716.158376:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207040640:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 171us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636716.158384:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 263 00000100:00100000:1.0:1788636716.158398:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 264 00000100:00100000:1.0:1788636716.158404:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207040256:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636716.158432:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207040256:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 28us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636716.158438:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 264 00000100:00100000:1.0:1788636716.158526:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 265 00000100:00100000:1.0:1788636716.158534:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207040512:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636716.158563:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207040512:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 32us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636716.158569:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 265 00000100:00100000:3.0:1788636716.158756:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207040000 00000100:00100000:3.0:1788636716.158762:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207040000 00000100:00100000:3.0:1788636716.158838:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 378 00000100:00100000:3.0:1788636716.158846:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2399:x1875521207040000:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636716.158873:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2399:x1875521207040000:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 29us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636716.158880:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 378 00000100:00100000:0.0:1788636716.159157:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207040384 00000100:00100000:0.0:1788636716.159162:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207040384 00000100:00100000:0.0:1788636716.159210:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 104 00000100:00100000:0.0:1788636716.159218:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207040384:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636716.159265:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207040384:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 48us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636716.159272:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 104 00000100:00080000:2.0:1788636716.159561:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636716.159576:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636716.159578:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636716.437117:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636717.205450:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226009984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636717.205571:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636717.205911:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226009984 00000100:00100000:3.0:1788636717.205923:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226009984 00000100:00100000:3.0:1788636717.206004:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788636717.206020:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226009984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636717.206067:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636717.206150:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226009984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636717.206158:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788636717.206228:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636717.206657:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788636717.206666:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf03fcc0e00, transno 4294967301 00000100:00100000:1.0:1788636717.206841:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226009984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636717.207476:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226010112:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.207551:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.207605:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226010624:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.207633:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.207650:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226011136:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.207684:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.207718:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226011136 00000100:00100000:2.0:1788636717.207725:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226011136 00000100:00100000:2.0:1788636717.207778:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788636717.207787:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226011136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.207863:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226011136:12345-0@lo:400:kworker.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636717.207871:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1788636717.207894:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636717.207907:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226010240:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.207935:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.207953:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226010752:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.207972:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.207986:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226011264:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208005:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.208029:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226010240 00000100:00100000:2.0:1788636717.208033:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226010240 00000100:00100000:2.0:1788636717.208058:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226010752 00000100:00100000:2.0:1788636717.208077:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226010752 00000100:00100000:2.0:1788636717.208100:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226011264 00000100:00100000:2.0:1788636717.208103:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226011264 00000100:00100000:2.0:1788636717.208117:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788636717.208123:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226010240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208152:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226010240:12345-0@lo:400:kworker.0 Request processed in 30us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636717.208159:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788636717.208170:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788636717.208175:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226010752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208199:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226010752:12345-0@lo:400:kworker.0 Request processed in 24us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636717.208205:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788636717.208216:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788636717.208222:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226011264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208246:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226011264:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636717.208252:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1788636717.208277:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636717.208304:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226011264:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208348:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226010240:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208357:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226010752:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208370:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788636717.208377:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226010368:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208404:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.208436:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226010880:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208459:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.208477:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226010880 00000100:00100000:2.0:1788636717.208481:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226010880 00000100:00100000:2.0:1788636717.208519:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788636717.208525:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226010880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208554:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226010880:12345-0@lo:400:kworker.0 Request processed in 30us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636717.208560:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:2.0:1788636717.208576:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788636717.208599:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03aba5500 x1875521226011136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636717.208611:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226011136:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208625:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788636717.208631:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226010496:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208661:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.208685:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226010496 00000100:00100000:2.0:1788636717.208689:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226010496 00000100:00100000:2.0:1788636717.208712:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788636717.208718:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226010496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208746:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226010496:12345-0@lo:400:kworker.0 Request processed in 28us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636717.208752:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788636717.208777:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226010496:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208783:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226011008:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208856:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.208883:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226011008 00000100:00100000:2.0:1788636717.208887:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226011008 00000100:00100000:2.0:1788636717.208923:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788636717.208931:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226011008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.208961:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226011008:12345-0@lo:400:kworker.0 Request processed in 31us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636717.208967:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788636717.208981:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636717.208996:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03aba5880 x1875521226011008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636717.209006:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226011008:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.209013:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226011520:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.209038:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788636717.209079:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03656300 x1875521226010880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636717.209088:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226010880:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.209096:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226011392:0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.209120:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636717.209143:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226011392 00000100:00100000:2.0:1788636717.209147:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226011392 00000100:00100000:2.0:1788636717.209180:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788636717.209187:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226011392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636717.209219:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226011392:12345-0@lo:400:kworker.0 Request processed in 32us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636717.209239:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1788636717.209254:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788636717.209273:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03aba6d80 x1875521226011392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636717.209282:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226011392:0@lo:400:kworker.0 00000100:00100000:3.0:1788636717.209950:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226010624 00000100:00100000:3.0:1788636717.209959:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226010624 00000100:00100000:3.0:1788636717.210009:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226010368 00000100:00100000:3.0:1788636717.210012:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226010368 00000100:00100000:3.0:1788636717.210029:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788636717.210037:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226010624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636717.210095:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226010624:12345-0@lo:400:kworker.0 Request processed in 59us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636717.210103:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788636717.210118:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788636717.210124:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226010368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636717.210157:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226010368:12345-0@lo:400:kworker.0 Request processed in 34us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636717.210163:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788636717.210182:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226011520 00000100:00100000:3.0:1788636717.210185:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226011520 00000100:00100000:3.0:1788636717.210217:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788636717.210223:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226011520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636717.210257:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226011520:12345-0@lo:400:kworker.0 Request processed in 35us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636717.210263:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788636717.210277:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636717.210307:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226011520:0@lo:400:kworker.0 00000100:00100000:3.0:1788636717.210334:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226010624:0@lo:400:kworker.0 00000100:00100000:1.0:1788636717.211940:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636717.211964:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226011648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636717.212026:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636717.212453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226010112 00000100:00100000:0.0:1788636717.212465:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226010112 00000100:00100000:0.0:1788636717.212542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788636717.212552:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226010112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636717.212618:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226010112:12345-0@lo:400:kworker.0 Request processed in 68us (5067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636717.212626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788636717.212670:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226011648 00000100:00100000:0.0:1788636717.212674:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226011648 00000100:00100000:0.0:1788636717.213012:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788636717.213020:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226011648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636717.213049:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636717.213096:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226011648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636717.213102:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788636717.214539:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226010112:0@lo:400:kworker.0 00000100:00100000:1.0:1788636717.214897:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226011648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636717.215163:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226010368:0@lo:400:kworker.0 00010000:00010000:2.0:1788636717.461111:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636718.485002:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636719.509765:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636719.765221:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226011776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636719.765311:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636719.765554:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226011904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636719.765591:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636719.765629:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226011776 00000100:00100000:0.0:1788636719.765637:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226011776 00000100:00100000:0.0:1788636719.765683:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226011904 00000100:00100000:0.0:1788636719.765687:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226011904 00000100:00100000:0.0:1788636719.765705:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788636719.765714:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226011776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788636719.765742:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636719.765776:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226011776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636719.765782:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788636719.765796:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788636719.765801:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226011904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636719.765842:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636719.765867:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226011904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636719.765872:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:0.0:1788636719.765908:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03aba4000 x1875521226011904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636719.765929:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226011904:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788636719.766078:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636719.766098:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf00f17b100 x1875521226011776/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636719.766110:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226011776:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636719.766444:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226012032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636719.766504:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636719.766616:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226012032 00000100:00100000:0.0:1788636719.766620:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226012032 00000100:00100000:0.0:1788636719.766652:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788636719.766658:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226012032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636719.766682:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636719.766723:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226012032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636719.766730:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788636719.766794:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226012032:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788636720.533052:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636720.789239:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636720.789264:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226012160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636720.789336:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636720.789531:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226012160 00000100:00100000:0.0:1788636720.789541:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226012160 00000100:00100000:0.0:1788636720.789605:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788636720.789616:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226012160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636720.789655:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788636720.789721:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226012160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636720.789729:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788636720.790046:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226012160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636721.282460:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636721.282505:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636721.282534:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207040896 00000100:00100000:2.0:1788636721.282535:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636721.282547:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207040896 00000100:00100000:2.0:1788636721.282566:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636721.282593:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207040768 00000100:00100000:2.0:1788636721.282597:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207040768 00000100:00100000:0.0:1788636721.282619:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207041408 00000100:00100000:0.0:1788636721.282624:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207041408 00000100:00100000:2.0:1788636721.282638:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 380 00000100:00100000:2.0:1788636721.282650:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207040768:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636721.282662:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 272 00000100:00100000:0.0:1788636721.282673:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207040896:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636721.282740:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207040768:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636721.282748:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 380 00000100:00100000:2.0:1788636721.282781:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207041152 00000100:00100000:2.0:1788636721.282785:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207041152 00000100:00100000:2.0:1788636721.282829:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 108 00000100:00100000:2.0:1788636721.282837:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207041152:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636721.282955:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 273 00000100:00100000:1.0:1788636721.282966:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207041408:12345-192.168.202.26@tcp:400:kworker.0 00000100:00080000:3.0:1788636721.283668:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636721.283678:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636721.283680:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636721.284981:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207040896:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 2300us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636721.284997:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 272 00000100:00100000:0.0:1788636721.291893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636721.291954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636721.292022:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207041024 00000100:00100000:0.0:1788636721.292035:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207041024 00000100:00100000:0.0:1788636721.292518:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207041280 00000100:00100000:0.0:1788636721.292526:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207041280 00000100:00100000:0.0:1788636721.292576:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 274 00000100:00100000:0.0:1788636721.292591:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207041024:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636721.292703:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207041024:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 117us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636721.292711:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 274 00000100:00100000:0.0:1788636721.292730:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 275 00000100:00100000:0.0:1788636721.292737:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207041280:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636721.292762:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207041280:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 26us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636721.292769:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 275 00000100:00080000:0.0:1788636721.292801:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636721.292827:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636721.294976:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207041152:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 12118us (12419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636721.294992:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 108 00000100:00100000:0.0:1788636721.298609:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207041408:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 15631us (16029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636721.298627:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 273 00010000:00010000:0.0:1788636721.573710:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788636722.261596:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788636722.325089:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226012288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636722.325181:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636722.325250:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636722.325258:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226012416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636722.325281:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636722.326291:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226012288 00000100:00100000:3.0:1788636722.326306:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226012288 00000100:00100000:3.0:1788636722.326384:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226012416 00000100:00100000:3.0:1788636722.326388:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226012416 00000100:00100000:3.0:1788636722.326409:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788636722.326419:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226012288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788636722.326464:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636722.326532:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226012288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636722.326540:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788636722.326557:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788636722.326563:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226012416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636722.326574:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636722.326598:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226012416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636722.326603:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788636722.326712:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636722.326755:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226012416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636722.326771:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226012288:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1788636722.327618:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788636722.337120:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226012544:0@lo:400:kworker.0 00000100:00100000:1.0:1788636722.337206:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636722.337526:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226012672:0@lo:400:kworker.0 00000100:00100000:0.0:1788636722.337574:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636722.337623:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226012672 00000100:00100000:0.0:1788636722.337631:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226012672 00000100:00100000:0.0:1788636722.337680:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788636722.337690:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226012672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636722.337758:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226012672:12345-0@lo:400:kworker.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636722.337766:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788636722.337842:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226012672:0@lo:400:kworker.0 00000100:00100000:3.0:1788636722.345673:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226012544 00000100:00100000:3.0:1788636722.345691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226012544 00000100:00100000:3.0:1788636722.345780:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788636722.345792:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226012544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347214:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226012928:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347270:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636722.347303:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226013440:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347328:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636722.347354:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788636722.347360:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226012800:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347383:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636722.347401:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226013312:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347421:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636722.347449:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226013824:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347468:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636722.347492:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226012928 00000100:00100000:2.0:1788636722.347499:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226012928 00000100:00100000:2.0:1788636722.347529:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226013312 00000100:00100000:2.0:1788636722.347543:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226013312 00000100:00100000:2.0:1788636722.347566:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226013824 00000100:00100000:2.0:1788636722.347568:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226013824 00000100:00100000:2.0:1788636722.347581:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788636722.347587:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226012928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347627:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226012928:12345-0@lo:400:kworker.0 Request processed in 39us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636722.347634:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788636722.347648:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788636722.347654:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226013312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347673:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226013312:12345-0@lo:400:kworker.0 Request processed in 20us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636722.347679:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788636722.347687:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788636722.347693:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226013824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347717:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226013824:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636722.347722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788636722.347738:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226013440 00000100:00100000:2.0:1788636722.347740:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226013440 00000100:00100000:2.0:1788636722.347760:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788636722.347765:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226013440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347829:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226013440:12345-0@lo:400:kworker.0 Request processed in 38us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636722.347837:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788636722.347855:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226012800 00000100:00100000:2.0:1788636722.347859:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226012800 00000100:00100000:2.0:1788636722.347890:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788636722.347896:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226012800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.347938:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226012800:12345-0@lo:400:kworker.0 Request processed in 42us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636722.347945:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788636722.347977:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226012800:0@lo:400:kworker.0 00010000:00080000:2.0:1788636722.347989:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d7b80 x1875521226013312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636722.347999:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226013312:0@lo:400:kworker.0 00010000:00080000:2.0:1788636722.348006:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d5880 x1875521226013824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636722.348014:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226013824:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.348021:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226012928:0@lo:400:kworker.0 00010000:00080000:2.0:1788636722.348029:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d4000 x1875521226013440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636722.348037:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226013440:0@lo:400:kworker.0 00000100:00080000:2.0:1788636722.348060:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636722.348064:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636722.348071:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226013184:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.348092:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636722.348106:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226013696:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.348120:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636722.348129:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788636722.348140:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226013056:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.348158:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636722.348174:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226013568:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.348191:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636722.348213:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226013056 00000100:00100000:2.0:1788636722.348230:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226013056 00000100:00100000:2.0:1788636722.348253:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788636722.348259:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226013056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.348292:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226013056:12345-0@lo:400:kworker.0 Request processed in 33us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636722.348299:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788636722.348314:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226013184 00000100:00100000:2.0:1788636722.348318:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226013184 00000100:00100000:2.0:1788636722.348335:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226013696 00000100:00100000:2.0:1788636722.348337:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226013696 00000100:00100000:2.0:1788636722.348348:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788636722.348353:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226013184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.348379:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226013184:12345-0@lo:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636722.348386:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788636722.348397:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788636722.348402:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226013696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.348424:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226013696:12345-0@lo:400:kworker.0 Request processed in 22us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636722.348441:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:2.0:1788636722.348452:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636722.348466:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226013056:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.348481:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fc71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226013184:0@lo:400:kworker.0 00000100:00100000:2.0:1788636722.348489:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226013696:0@lo:400:kworker.0 00000100:00100000:0.0:1788636722.349020:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226013568 00000100:00100000:0.0:1788636722.349026:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226013568 00000100:00100000:0.0:1788636722.349069:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788636722.349076:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226013568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636722.349122:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226013568:12345-0@lo:400:kworker.0 Request processed in 47us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636722.349129:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1788636722.349182:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d4a80 x1875521226013568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636722.349192:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226013568:0@lo:400:kworker.0 00000100:00080000:2.0:1788636722.350486:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636722.354408:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226012544:12345-0@lo:400:kworker.0 Request processed in 8608us (17192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636722.354427:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788636722.354948:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226012544:0@lo:400:kworker.0 00010000:00010000:2.0:1788636722.581132:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636723.607212:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636724.629110:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636724.885098:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636724.885132:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226013952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636724.885225:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636724.885445:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226014080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636724.885489:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636724.885692:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226013952 00000100:00100000:2.0:1788636724.885700:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226013952 00000100:00100000:2.0:1788636724.885767:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226014080 00000100:00100000:2.0:1788636724.885771:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226014080 00000100:00100000:1.0:1788636724.885772:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788636724.885784:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226013952:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636724.885786:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788636724.885791:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226014080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636724.885832:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788636724.885832:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636724.885875:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226014080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636724.885876:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226013952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636724.885882:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788636724.885943:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226014208:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788636724.886184:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d6a00 x1875521226014080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636724.886203:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226014080:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788636724.886236:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03aba5c00 x1875521226013952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636724.886256:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226013952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636724.886557:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636724.886654:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226014208 00000100:00100000:2.0:1788636724.886660:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226014208 00000100:00100000:2.0:1788636724.886741:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788636724.886751:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226014208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636724.886842:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636724.886894:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226014208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636724.886901:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1788636724.886973:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636724.889049:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788636724.889179:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226014208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788636725.653092:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636725.911123:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226014336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636725.911241:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636725.911433:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226014336 00000100:00100000:0.0:1788636725.911443:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226014336 00000100:00100000:0.0:1788636725.911528:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788636725.911539:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226014336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636725.911589:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788636725.911647:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226014336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636725.911654:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788636725.912666:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226014336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636726.401197:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636726.401241:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636726.401296:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636726.401445:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207041792 00000100:00100000:1.0:1788636726.401456:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207041792 00000100:00100000:1.0:1788636726.401523:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207041664 00000100:00100000:1.0:1788636726.401526:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207041664 00000100:00100000:1.0:1788636726.401547:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 282 00000100:00100000:1.0:1788636726.401558:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207041792:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636726.401630:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207041792:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 74us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636726.401638:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 282 00000100:00100000:1.0:1788636726.401656:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 283 00000100:00100000:1.0:1788636726.401662:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207041664:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636726.401691:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207041664:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 29us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636726.401697:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 283 00000100:00100000:0.0:1788636726.401993:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207041536 00000100:00100000:0.0:1788636726.401998:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207041536 00000100:00100000:0.0:1788636726.402040:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 382 00000100:00100000:0.0:1788636726.402047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207041536:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636726.402077:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207041536:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 31us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636726.402094:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 382 00000100:00080000:2.0:1788636726.402788:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636726.402795:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636726.417388:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636726.417464:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636726.417498:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636726.417598:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207042176 00000100:00100000:1.0:1788636726.417609:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207042176 00000100:00100000:1.0:1788636726.417684:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207042048 00000100:00100000:1.0:1788636726.417688:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207042048 00000100:00100000:1.0:1788636726.417711:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 284 00000100:00100000:1.0:1788636726.417720:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207042176:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636726.417796:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207042176:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 76us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636726.417803:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 284 00000100:00100000:1.0:1788636726.417852:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 285 00000100:00100000:1.0:1788636726.417859:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207042048:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636726.417902:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207042048:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 44us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636726.417908:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 285 00000100:00100000:2.0:1788636726.418085:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207041920 00000100:00100000:2.0:1788636726.418090:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207041920 00000100:00100000:2.0:1788636726.418135:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:2.0:1788636726.418143:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2397:x1875521207041920:12345-192.168.202.26@tcp:9:kworker.0 00000020:00000080:2.0:1788636726.418164:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838431 00000100:00080000:2.0:1788636726.418173:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9cf03aa7b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788636726.418215:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788636726.418353:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+2:2397:x1875521207041920:12345-192.168.202.26@tcp:9:kworker.0 Request processed in 210us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636726.418360:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 27 00010000:00010000:2.0:1788636726.418378:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788636726.418699:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636726.418705:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636726.418707:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788636726.677473:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636727.445174:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226014464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636727.445248:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636727.445433:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226014464 00000100:00100000:1.0:1788636727.445441:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226014464 00000100:00100000:1.0:1788636727.445497:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788636727.445504:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226014464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636727.445531:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636727.445576:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226014464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636727.445581:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1788636727.445634:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636727.445666:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226014464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636727.446013:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226014976:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.446047:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636727.446067:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226015488:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.446113:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636727.446139:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226016000:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.446160:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636727.446175:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788636727.446181:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226014848:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.446204:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636727.446220:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226015360:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.446239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636727.446252:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226015872:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.446270:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636727.446479:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226014720:0@lo:400:kworker.0 00000100:00100000:1.0:1788636727.446508:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636727.446534:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226015232:0@lo:400:kworker.0 00000100:00100000:1.0:1788636727.446553:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636727.446573:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226015744:0@lo:400:kworker.0 00000100:00100000:1.0:1788636727.446592:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636727.446604:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788636727.446609:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226014592:0@lo:400:kworker.0 00000100:00100000:1.0:1788636727.446634:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636727.446653:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226015104:0@lo:400:kworker.0 00000100:00100000:1.0:1788636727.446673:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636727.446687:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226015616:0@lo:400:kworker.0 00000100:00100000:1.0:1788636727.446704:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636727.446739:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226015488 00000100:00100000:1.0:1788636727.446745:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226015488 00000100:00100000:1.0:1788636727.446780:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226016000 00000100:00100000:1.0:1788636727.446782:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226016000 00000100:00100000:1.0:1788636727.446798:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226015616 00000100:00100000:1.0:1788636727.446800:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226015616 00000100:00100000:1.0:1788636727.446836:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788636727.446842:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226015488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636727.446879:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226015488:12345-0@lo:400:kworker.0 Request processed in 37us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636727.446885:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788636727.446897:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788636727.446901:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226016000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636727.446922:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226016000:12345-0@lo:400:kworker.0 Request processed in 21us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636727.446927:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788636727.446935:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788636727.446939:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226015616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636727.446962:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226015616:12345-0@lo:400:kworker.0 Request processed in 22us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636727.446967:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788636727.447074:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226014592 00000100:00100000:3.0:1788636727.447079:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226014592 00000100:00100000:3.0:1788636727.447104:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788636727.447110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf005690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226014592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448183:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf005690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226014592:12345-0@lo:400:kworker.0 Request processed in 1067us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636727.448192:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788636727.448244:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226014976 00000100:00100000:3.0:1788636727.448249:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226014976 00000100:00100000:3.0:1788636727.448275:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226015360 00000100:00100000:3.0:1788636727.448278:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226015360 00000100:00100000:3.0:1788636727.448292:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226015872 00000100:00100000:3.0:1788636727.448294:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226015872 00000100:00100000:3.0:1788636727.448305:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226014720 00000100:00100000:3.0:1788636727.448307:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226014720 00000100:00100000:3.0:1788636727.448317:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226015232 00000100:00100000:3.0:1788636727.448319:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226015232 00000100:00100000:3.0:1788636727.448329:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226015744 00000100:00100000:3.0:1788636727.448344:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226015744 00000100:00100000:3.0:1788636727.448360:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788636727.448366:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226014976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448421:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226014976:12345-0@lo:400:kworker.0 Request processed in 55us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636727.448427:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788636727.448439:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788636727.448445:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226015360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448473:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226015360:12345-0@lo:400:kworker.0 Request processed in 29us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636727.448479:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788636727.448489:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788636727.448495:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226015872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448523:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226015872:12345-0@lo:400:kworker.0 Request processed in 29us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636727.448528:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788636727.448538:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788636727.448543:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226014720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448568:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226014720:12345-0@lo:400:kworker.0 Request processed in 25us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636727.448574:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788636727.448585:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788636727.448591:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226015232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448617:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226015232:12345-0@lo:400:kworker.0 Request processed in 26us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636727.448632:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788636727.448644:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788636727.448649:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226015744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448674:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226015744:12345-0@lo:400:kworker.0 Request processed in 26us (2082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636727.448678:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00010000:00080000:3.0:1788636727.448715:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03791180 x1875521226015360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636727.448727:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226015360:0@lo:400:kworker.0 00010000:00080000:3.0:1788636727.448736:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03790700 x1875521226015872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636727.448742:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226015872:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448749:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226014976:0@lo:400:kworker.0 00010000:00080000:3.0:1788636727.448757:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03793480 x1875521226015488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636727.448763:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226015488:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448770:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226016000:0@lo:400:kworker.0 00000100:00080000:3.0:1788636727.448850:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636727.448854:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636727.448856:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636727.448858:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636727.448888:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226014592:0@lo:400:kworker.0 00010000:00080000:3.0:1788636727.448898:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03790e00 x1875521226015616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636727.448909:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226015616:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448918:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226014720:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448925:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226015232:0@lo:400:kworker.0 00000100:00100000:3.0:1788636727.448931:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226015744:0@lo:400:kworker.0 00000100:00100000:2.0:1788636727.449358:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226014848 00000100:00100000:2.0:1788636727.449367:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226014848 00000100:00100000:2.0:1788636727.449419:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226015104 00000100:00100000:2.0:1788636727.449423:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226015104 00000100:00100000:2.0:1788636727.449449:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788636727.449456:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226014848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636727.449521:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226014848:12345-0@lo:400:kworker.0 Request processed in 65us (3314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636727.449528:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788636727.449543:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788636727.449548:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226015104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636727.449574:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226015104:12345-0@lo:400:kworker.0 Request processed in 27us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636727.449578:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788636727.449609:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032404380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226014848:0@lo:400:kworker.0 00000100:00100000:2.0:1788636727.449628:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226015104:0@lo:400:kworker.0 00000100:00100000:2.0:1788636727.450665:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226016128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636727.450714:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636727.450795:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226016128 00000100:00100000:0.0:1788636727.450800:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226016128 00000100:00100000:0.0:1788636727.450848:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788636727.450854:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226016128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636727.450871:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636727.450905:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226016128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636727.450909:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788636727.450938:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226016128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788636727.701769:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636728.726441:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636729.749191:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636730.005273:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226016256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636730.005370:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636730.005803:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226016256 00000100:00100000:2.0:1788636730.005841:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226016256 00000100:00100000:1.0:1788636730.005955:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226016384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636730.006005:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788636730.006047:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636730.006048:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636730.006057:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226016512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636730.006117:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636730.006119:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226016384 00000100:00100000:0.0:1788636730.006125:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226016384 00000100:00080000:1.0:1788636730.006171:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636730.006195:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788636730.006210:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226016384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636730.006254:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636730.006324:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226016384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636730.006332:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788636730.006454:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226016512 00000100:00100000:3.0:1788636730.006458:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226016512 00000100:00100000:3.0:1788636730.006499:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788636730.006506:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226016512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788636730.006547:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788636730.006594:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226016512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636730.006600:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788636730.006704:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788636730.006712:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226016256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636730.006724:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636730.006767:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226016256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636730.006773:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:3.0:1788636730.006901:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d4e00 x1875521226016256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636730.006920:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226016256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636730.007459:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226016512:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788636730.007486:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03aba4380 x1875521226016384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636730.007510:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226016384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788636730.775253:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636731.029003:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226016640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636731.029122:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636731.029167:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226016640 00000100:00100000:2.0:1788636731.029177:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226016640 00000100:00100000:2.0:1788636731.037000:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788636731.037028:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226016640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788636731.037073:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788636731.037168:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226016640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (8059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636731.037176:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788636731.038553:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226016640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636731.525758:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636731.525821:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636731.525848:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636731.525866:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636731.525895:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636731.525934:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207042304 00000100:00100000:2.0:1788636731.525945:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207042304 00000100:00100000:2.0:1788636731.526000:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 384 00000100:00100000:2.0:1788636731.526011:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207042304:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636731.526087:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207042304:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636731.526095:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 384 00000100:00100000:2.0:1788636731.526129:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207042560 00000100:00100000:2.0:1788636731.526133:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207042560 00000100:00100000:2.0:1788636731.526172:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207042816 00000100:00100000:2.0:1788636731.526175:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207042816 00000100:00100000:2.0:1788636731.526189:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207042432 00000100:00100000:2.0:1788636731.526191:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207042432 00000100:00100000:2.0:1788636731.526202:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207042688 00000100:00100000:2.0:1788636731.526204:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207042688 00000100:00100000:2.0:1788636731.526219:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 292 00000100:00100000:2.0:1788636731.526236:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207042560:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636731.526268:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207042560:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636731.526275:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 292 00000100:00100000:2.0:1788636731.526289:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 293 00000100:00100000:2.0:1788636731.526296:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207042816:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636731.526323:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207042816:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636731.526329:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 293 00000100:00100000:2.0:1788636731.526341:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 294 00000100:00100000:2.0:1788636731.526347:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207042432:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636731.526372:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207042432:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 25us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636731.526378:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 294 00000100:00100000:2.0:1788636731.526401:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 295 00000100:00100000:2.0:1788636731.526408:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207042688:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636731.526431:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207042688:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 24us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636731.526436:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 295 00000100:00080000:2.0:1788636731.526929:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636731.526935:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788636731.797095:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788636732.061103:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000020:00000080:0.0:1788636732.061114:0:9516:0:(genops.c:885:class_export_put()) final put ffff9cf03aa7e000/a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000020:00000080:2.0:1788636732.062235:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03aa7e000/a3091a46-1ad5-4415-b7a7-5e4bfab40689 for lustre-OST0001 00000020:00000080:2.0:1788636732.062302:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03aa7b000 for lustre-OST0001 00000040:00080000:0.0:1788636732.502144:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788636732.565375:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226016768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636732.565491:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.565583:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226016768 00000100:00100000:3.0:1788636732.565591:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226016768 00000100:00100000:3.0:1788636732.565651:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788636732.565670:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226016768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788636732.565701:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636732.565749:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226016768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.565755:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1788636732.565779:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636732.565841:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226016768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636732.566739:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226016896:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.566788:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.566937:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226017408:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.566964:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.566984:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226017920:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.567006:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.567030:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788636732.567037:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226017024:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.567062:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.567081:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226017536:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.567101:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.567750:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226018048:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.567781:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.567827:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226018432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636732.567853:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.567892:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226017408 00000100:00100000:3.0:1788636732.567899:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226017408 00000100:00100000:3.0:1788636732.567943:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788636732.567964:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226017408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.568021:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226017408:12345-0@lo:400:kworker.0 Request processed in 58us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.568028:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788636732.568053:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226017920 00000100:00100000:3.0:1788636732.568058:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226017920 00000100:00100000:3.0:1788636732.568093:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788636732.568100:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226017920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636732.568311:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226016896 00000100:00100000:1.0:1788636732.568316:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226016896 00000040:00080000:0.0:1788636732.568568:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788636732.569040:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226017920:12345-0@lo:400:kworker.0 Request processed in 938us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.569051:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788636732.569079:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226017024 00000100:00100000:3.0:1788636732.569084:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226017024 00000100:00100000:3.0:1788636732.569119:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226017536 00000100:00100000:3.0:1788636732.569132:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226017536 00000100:00100000:3.0:1788636732.569158:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226018048 00000100:00100000:3.0:1788636732.569161:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226018048 00000100:00100000:3.0:1788636732.569177:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788636732.569184:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226017024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569220:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226017024:12345-0@lo:400:kworker.0 Request processed in 37us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.569227:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788636732.569240:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788636732.569246:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226017536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569273:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226017536:12345-0@lo:400:kworker.0 Request processed in 27us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.569279:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788636732.569299:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788636732.569305:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226018048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569334:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032404380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226018048:12345-0@lo:400:kworker.0 Request processed in 29us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.569339:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788636732.569364:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226018432 00000100:00100000:3.0:1788636732.569369:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226018432 00000100:00100000:3.0:1788636732.569408:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788636732.569415:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226018432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636732.569430:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636732.569459:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226018432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.569464:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788636732.569497:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226017152:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569528:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.569551:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226017664:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569571:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.569586:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521226018176:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569605:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.569624:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788636732.569631:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226017280:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569650:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.569666:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226017792:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569688:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.569707:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226018304:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569738:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636732.569767:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226017152 00000100:00100000:3.0:1788636732.569772:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226017152 00000100:00100000:3.0:1788636732.569798:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788636732.569842:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226017152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569882:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226017152:12345-0@lo:400:kworker.0 Request processed in 77us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.569888:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788636732.569907:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226017792 00000100:00100000:3.0:1788636732.569911:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226017792 00000100:00100000:3.0:1788636732.569933:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226018304 00000100:00100000:3.0:1788636732.569936:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226018304 00000100:00100000:3.0:1788636732.569953:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788636732.569959:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226017792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.569987:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226017792:12345-0@lo:400:kworker.0 Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.569994:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788636732.570005:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788636732.570011:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226018304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.570035:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226018304:12345-0@lo:400:kworker.0 Request processed in 24us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.570041:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788636732.570062:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226017664 00000100:00100000:3.0:1788636732.570066:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226017664 00000100:00100000:3.0:1788636732.570088:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226018176 00000100:00100000:3.0:1788636732.570091:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226018176 00000100:00100000:3.0:1788636732.570104:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226017280 00000100:00100000:3.0:1788636732.570107:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226017280 00000100:00100000:3.0:1788636732.570130:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788636732.570136:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226017664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.570165:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226017664:12345-0@lo:400:kworker.0 Request processed in 29us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.570170:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788636732.570182:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788636732.570188:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521226018176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.570213:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521226018176:12345-0@lo:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.570219:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788636732.570232:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788636732.570237:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226017280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.570277:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226017280:12345-0@lo:400:kworker.0 Request processed in 39us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636732.570283:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:3.0:1788636732.570303:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636732.570308:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636732.570310:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636732.570312:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636732.570353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226017280:0@lo:400:kworker.0 00010000:00080000:3.0:1788636732.570367:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef037a9880 x1875521226017792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636732.570376:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226017792:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.570400:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226018304:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.570410:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226017152:0@lo:400:kworker.0 00010000:00080000:3.0:1788636732.570429:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef037ab800 x1875521226017664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636732.570437:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226017664:0@lo:400:kworker.0 00010000:00080000:3.0:1788636732.570445:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef037ab480 x1875521226018176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636732.570452:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521226018176:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.570503:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226018432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636732.570514:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226017024:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.570524:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226017536:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.570533:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226018048:0@lo:400:kworker.0 00000100:00100000:3.0:1788636732.570545:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226017408:0@lo:400:kworker.0 00010000:00080000:3.0:1788636732.570555:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef037a9180 x1875521226017920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636732.570562:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226017920:0@lo:400:kworker.0 00000100:00100000:2.0:1788636732.574845:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788636732.574880:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521226016896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636732.574983:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521226016896:12345-0@lo:400:kworker.0 Request processed in 111us (8193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636732.574991:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788636732.577933:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226016896:0@lo:400:kworker.0 00010000:00010000:2.0:1788636732.822882:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636733.847951:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636734.874381:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636735.124995:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636735.125017:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226018560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636735.125085:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636735.125149:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226018688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636735.125176:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636735.125214:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226018560 00000100:00100000:1.0:1788636735.125221:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226018560 00000100:00100000:1.0:1788636735.125274:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788636735.125284:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226018560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636735.125312:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636735.125355:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226018560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636735.125362:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788636735.125398:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226018688 00000100:00100000:1.0:1788636735.125402:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226018688 00000100:00100000:1.0:1788636735.125425:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788636735.125431:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226018688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788636735.125464:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788636735.125497:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226018688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636735.125503:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1788636735.125518:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636735.125544:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef037a9c00 x1875521226018560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636735.125564:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226018560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636735.125598:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226018688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636735.130463:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226018816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636735.130533:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636735.130601:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226018816 00000100:00100000:1.0:1788636735.130610:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226018816 00000100:00100000:1.0:1788636735.130671:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788636735.130680:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226018816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636735.130705:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636735.130750:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226018816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636735.130757:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1788636735.130777:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636735.130822:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03791180 x1875521226018816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636735.130842:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226018816:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788636735.895387:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636736.149103:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226018944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636736.149180:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636736.149299:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226018944 00000100:00100000:3.0:1788636736.149308:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226018944 00000100:00100000:3.0:1788636736.149399:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788636736.149410:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226018944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636736.149446:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788636736.154889:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226018944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5470us (5698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636736.154923:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788636736.156194:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226018944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636736.640672:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636736.640719:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636736.640747:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636736.640786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636736.640842:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636736.640939:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207043200 00000100:00100000:1.0:1788636736.640964:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207043200 00000100:00100000:1.0:1788636736.641043:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207043456 00000100:00100000:1.0:1788636736.641046:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207043456 00000100:00100000:1.0:1788636736.641059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207043072 00000100:00100000:1.0:1788636736.641060:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207043072 00000100:00100000:1.0:1788636736.641071:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207043328 00000100:00100000:1.0:1788636736.641073:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207043328 00000100:00100000:1.0:1788636736.641091:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 302 00000100:00100000:1.0:1788636736.641101:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207043200:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636736.641170:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207043200:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 71us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636736.641177:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 302 00000100:00100000:1.0:1788636736.641196:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 303 00000100:00100000:1.0:1788636736.641203:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207043456:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636736.641229:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207043456:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636736.641235:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 303 00000100:00100000:1.0:1788636736.641246:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 304 00000100:00100000:1.0:1788636736.641251:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207043072:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636736.641271:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207043072:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 21us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636736.641278:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 304 00000100:00100000:1.0:1788636736.641290:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 305 00000100:00100000:1.0:1788636736.641297:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207043328:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636736.641323:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207043328:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636736.641334:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 305 00000100:00080000:0.0:1788636736.641679:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636736.641683:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636736.641753:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207042944 00000100:00100000:2.0:1788636736.641758:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207042944 00000100:00100000:2.0:1788636736.641797:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 386 00000100:00100000:2.0:1788636736.641804:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2399:x1875521207042944:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636736.641866:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2399:x1875521207042944:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 63us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636736.641872:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 386 00010000:00010000:2.0:1788636736.921119:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636737.685127:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636737.685159:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226019072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636737.685260:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636737.685336:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226019072 00000100:00100000:3.0:1788636737.685347:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226019072 00000100:00100000:3.0:1788636737.685430:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788636737.685443:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226019072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788636737.685609:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636737.685670:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226019072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 230us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636737.685679:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788636737.685740:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226019072:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788636737.685991:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636737.686003:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636737.686015:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226019200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636737.686056:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636737.686090:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226019200 00000100:00100000:0.0:1788636737.686095:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226019200 00000100:00100000:0.0:1788636737.686132:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788636737.686139:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226019200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636737.686153:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636737.686188:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226019200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636737.686194:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1788636737.686210:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636737.686234:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226019200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636737.688323:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226019712:0@lo:400:kworker.0 00000100:00100000:3.0:1788636737.688424:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636737.688892:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226020224:0@lo:400:kworker.0 00000100:00100000:3.0:1788636737.688932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636737.688964:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788636737.688971:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226019328:0@lo:400:kworker.0 00000100:00100000:3.0:1788636737.689003:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636737.689026:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226019840:0@lo:400:kworker.0 00000100:00100000:3.0:1788636737.689052:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636737.689068:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226020352:0@lo:400:kworker.0 00000100:00100000:3.0:1788636737.689086:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636737.689134:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226019712 00000100:00100000:3.0:1788636737.689144:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226019712 00000100:00100000:3.0:1788636737.689204:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788636737.689214:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226019712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636737.689273:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226019712:12345-0@lo:400:kworker.0 Request processed in 60us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636737.689280:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788636737.689306:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226020224 00000100:00100000:3.0:1788636737.689310:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226020224 00000100:00100000:3.0:1788636737.689341:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226020352 00000100:00100000:3.0:1788636737.689344:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226020352 00000100:00100000:3.0:1788636737.689377:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788636737.689384:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226020224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636737.689416:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226020224:12345-0@lo:400:kworker.0 Request processed in 33us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636737.689423:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788636737.689435:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788636737.689441:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226020352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636737.689665:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226019328 00000100:00100000:1.0:1788636737.689670:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226019328 00000100:00100000:1.0:1788636737.689705:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788636737.689712:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226019328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636737.690411:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226019584:0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.691023:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226019456:0@lo:400:kworker.0 00000100:00100000:0.0:1788636737.694388:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636737.694475:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226020096:0@lo:400:kworker.0 00000100:00100000:0.0:1788636737.694526:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636737.694556:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226020608:0@lo:400:kworker.0 00000100:00100000:0.0:1788636737.694582:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636737.694763:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226019840 00000100:00100000:0.0:1788636737.694773:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226019840 00000100:00100000:0.0:1788636737.694860:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226019584 00000100:00100000:0.0:1788636737.694863:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226019584 00000100:00100000:0.0:1788636737.694885:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788636737.694895:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226019840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636737.694962:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226019840:12345-0@lo:400:kworker.0 Request processed in 68us (5909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636737.694970:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788636737.694990:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788636737.694997:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226019584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636737.695034:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226019584:12345-0@lo:400:kworker.0 Request processed in 37us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636737.695040:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788636737.695084:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226019584:0@lo:400:kworker.0 00000100:00080000:0.0:1788636737.695114:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636737.705306:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226019328:12345-0@lo:400:kworker.0 Request processed in 15577us (16285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636737.705328:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788636737.705971:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226020096 00000100:00100000:1.0:1788636737.705986:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226020096 00000100:00100000:1.0:1788636737.706067:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226020608 00000100:00100000:1.0:1788636737.706070:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226020608 00000100:00100000:1.0:1788636737.706096:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788636737.706107:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226020096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636737.706198:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226020096:12345-0@lo:400:kworker.0 Request processed in 93us (11671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636737.706205:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788636737.706218:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788636737.706225:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226020608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636737.706253:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226020608:12345-0@lo:400:kworker.0 Request processed in 30us (11671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636737.706259:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:1.0:1788636737.706285:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788636737.706329:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03651180 x1875521226020096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636737.706348:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226020096:0@lo:400:kworker.0 00010000:00080000:1.0:1788636737.706394:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03724380 x1875521226020608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636737.706404:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226020608:0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.713708:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636737.713786:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226019968:0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.713858:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636737.713883:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226020480:0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.713908:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636737.713970:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226019456 00000100:00100000:2.0:1788636737.713992:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226019456 00000100:00100000:2.0:1788636737.714060:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226019968 00000100:00100000:2.0:1788636737.714063:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226019968 00000100:00100000:2.0:1788636737.714092:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226020480 00000100:00100000:2.0:1788636737.714095:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226020480 00000100:00100000:2.0:1788636737.714130:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788636737.714141:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226019456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.714210:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226019456:12345-0@lo:400:kworker.0 Request processed in 70us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636737.714219:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788636737.714238:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788636737.714244:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226019968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.714275:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226019968:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636737.714281:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788636737.714293:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788636737.714298:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226020480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.714322:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226020480:12345-0@lo:400:kworker.0 Request processed in 23us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636737.714327:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:2.0:1788636737.714343:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636737.714397:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226019456:0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.714409:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226019968:0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.714418:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226020480:0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.714596:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226019328:0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.714628:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226019840:0@lo:400:kworker.0 00010000:00080000:2.0:1788636737.714645:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03652d80 x1875521226020352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636737.714657:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226020352:0@lo:400:kworker.0 00000100:00100000:2.0:1788636737.714672:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03650a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226019712:0@lo:400:kworker.0 00010000:00080000:2.0:1788636737.714685:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03651f80 x1875521226020224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636737.714693:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226020224:0@lo:400:kworker.0 00000100:00100000:3.0:1788636737.721271:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226020352:12345-0@lo:400:kworker.0 Request processed in 31780us (32133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636737.721293:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00010000:0.0:1788636737.945113:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788636737.986506:0:14068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:32:16 (1788636736) 00010000:00010000:2.0:1788636738.965406:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636739.817620:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636739.817751:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207043584 00000100:00100000:2.0:1788636739.817764:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207043584 00000100:00100000:2.0:1788636739.817885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 40 00000100:00100000:2.0:1788636739.817900:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:11083:x1875521207043584:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636739.817923:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636739.819394:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e838511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38fac expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.819515:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e838518 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.819532:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e838518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.819550:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e838518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636739.819649:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788636739.819654:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636739.819702:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e838518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.819734:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e838511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fac expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.819756:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e838518 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fac expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.819764:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636739.819767:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636739.819771:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e000, rc 0) 00000100:00100000:2.0:1788636739.819901:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:11083:x1875521207043584:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 2005us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636739.819913:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 40 00000100:00080000:1.0:1788636739.820299:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636739.843207:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636739.850302:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207043712 00000100:00100000:3.0:1788636739.850326:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207043712 00000100:00100000:3.0:1788636739.850514:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 41 00000100:00100000:3.0:1788636739.850527:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:11084:x1875521207043712:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636739.850567:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636739.850594:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83851f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38fb3 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850690:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838526 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850723:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838526 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850737:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838526 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850753:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e83852d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850759:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e83852d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850766:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e83852d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850864:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838534 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850873:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838534 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850879:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838534 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636739.850927:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788636739.850937:0:13298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636739.850967:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838534 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850982:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838526 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.850999:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838526 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851008:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838526 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851015:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015991200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636739.851022:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838526 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851032:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838526 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851050:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:3.0:1788636739.851053:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636739.851059:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838526 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851066:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838526 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851086:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e83852d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851092:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e83852d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851108:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e83852d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851114:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636739.851117:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e83852d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851123:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e83852d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851132:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cef0331c300) 00010000:00010000:3.0:1788636739.851134:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636739.851138:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e83852d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851144:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e83852d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851190:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83851f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fb3 expref: 8 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851205:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838534 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fb3 expref: 7 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636739.851212:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cef0331c100) 00010000:00010000:3.0:1788636739.851214:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636739.851217:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015990200, rc 0) 00000100:00100000:3.0:1788636739.853189:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:11084:x1875521207043712:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 2648us (9977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636739.853223:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 41 00000100:00100000:0.0:1788636739.885979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636739.886197:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207043840 00000100:00100000:2.0:1788636739.886209:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207043840 00000100:00100000:2.0:1788636739.886294:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:2.0:1788636739.886308:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:11084:x1875521207043840:12345-192.168.202.26@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788636739.886428:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:11084:x1875521207043840:12345-192.168.202.26@tcp:900:lhsmtool_posix.0 Request processed in 122us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636739.886437:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:0.0:1788636739.897681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636739.897877:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207044096 00000100:00100000:2.0:1788636739.897926:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207044096 00000100:00100000:2.0:1788636739.898014:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 42 00000100:00100000:2.0:1788636739.898027:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:11084:x1875521207044096:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636739.898049:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636739.898076:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e83853b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38fba expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898164:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e838542 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898182:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e838542 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898196:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e838542 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898258:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838549 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898267:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838549 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898276:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838549 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898426:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0c00/0x5b741ef42e838550 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898436:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0c00/0x5b741ef42e838550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898443:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0c00/0x5b741ef42e838550 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636739.898461:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788636739.898554:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e838542 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898562:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e838542 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898569:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e838542 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898575:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153ec00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636739.898580:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e838542 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898588:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e838542 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898601:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cef0331c100) 00010000:00010000:2.0:1788636739.898605:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636739.898610:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e838542 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898617:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e838542 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898636:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838549 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898642:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838549 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898660:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838549 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898666:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636739.898669:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838549 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898676:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838549 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898685:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cf03a5ec500) 00010000:00010000:2.0:1788636739.898688:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636739.898691:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838549 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.898696:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838549 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.900543:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e83853b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fba expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.900579:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0c00/0x5b741ef42e838550 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fba expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636739.900589:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:2.0:1788636739.900592:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636739.900597:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0c00, rc 0) 00000100:00100000:2.0:1788636739.900707:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:11084:x1875521207044096:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 2681us (3041us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788636739.900741:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 42 00000100:00100000:0.0:1788636739.906001:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636739.908339:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207044224 00000100:00100000:2.0:1788636739.908395:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207044224 00000100:00100000:2.0:1788636739.908497:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 43 00000100:00100000:2.0:1788636739.908508:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:11084:x1875521207044224:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788636739.908638:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:11084:x1875521207044224:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 Request processed in 132us (2656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636739.908646:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 43 00000100:00100000:0.0:1788636739.915765:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636739.917481:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207044352 00000100:00100000:3.0:1788636739.917503:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207044352 00000100:00100000:3.0:1788636739.917645:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 44 00000100:00100000:3.0:1788636739.917664:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:11084:x1875521207044352:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788636739.917857:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788636739.920555:0:13298:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2822us 00000100:00100000:3.0:1788636739.982650:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:11084:x1875521207044352:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 Request processed in 64977us (66884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636739.982671:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 44 00010000:00010000:2.0:1788636739.996642:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636740.245519:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226020736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636740.245701:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636740.245855:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226020736 00000100:00100000:1.0:1788636740.246038:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226020736 00000100:00100000:1.0:1788636740.246273:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788636740.246290:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226020736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788636740.246441:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788636740.246621:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226020736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 329us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636740.246634:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788636740.246743:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226020736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636740.247283:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226020864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636740.247371:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636740.247456:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226020864 00000100:00100000:1.0:1788636740.247470:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226020864 00000100:00100000:1.0:1788636740.251981:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788636740.252005:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226020864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636740.252058:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636740.252176:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226020864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (4804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636740.252183:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1788636740.252337:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636740.252414:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03653100 x1875521226020864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636740.252470:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03653100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226020864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636740.257915:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636740.258136:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226020992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636740.258270:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636740.258389:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226020992 00000100:00100000:3.0:1788636740.258402:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226020992 00000100:00100000:3.0:1788636740.258496:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788636740.258509:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226020992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636740.258545:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636740.258606:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226020992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636740.258616:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1788636740.258652:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636740.258699:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03726680 x1875521226020992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636740.258725:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226020992:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788636740.694382:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788636740.758564:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788636741.014272:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636741.272844:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226021120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636741.272927:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636741.273103:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226021120 00000100:00100000:3.0:1788636741.273112:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226021120 00000100:00100000:3.0:1788636741.273168:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788636741.273178:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226021120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636741.273211:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788636741.273257:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226021120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636741.273263:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788636741.273426:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03726680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226021120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636741.768026:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636741.768075:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636741.768317:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207044608 00000100:00100000:1.0:1788636741.768329:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207044608 00000100:00100000:1.0:1788636741.768434:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 312 00000100:00100000:1.0:1788636741.768456:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2398:x1875521207044608:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636741.768532:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2398:x1875521207044608:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 89us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636741.768540:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 312 00000100:00080000:3.0:1788636741.770869:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636741.771268:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207044480 00000100:00100000:2.0:1788636741.771283:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207044480 00000100:00100000:2.0:1788636741.771394:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 388 00000100:00100000:2.0:1788636741.771406:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207044480:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636741.772001:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207044480:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 595us (3982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636741.772009:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 388 00000100:00100000:3.0:1788636741.784982:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636741.785026:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636741.785060:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636741.785161:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207044864 00000100:00100000:0.0:1788636741.785173:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207044864 00000100:00100000:0.0:1788636741.785250:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207044736 00000100:00100000:0.0:1788636741.785254:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207044736 00000100:00100000:0.0:1788636741.785275:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207044992 00000100:00100000:0.0:1788636741.785277:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207044992 00000100:00100000:0.0:1788636741.785307:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 313 00000100:00100000:0.0:1788636741.785318:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207044864:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636741.785403:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207044864:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 86us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636741.785411:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 313 00000100:00100000:0.0:1788636741.785429:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 314 00000100:00100000:0.0:1788636741.785437:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207044736:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636741.785475:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2399:x1875521207044736:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 40us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636741.785481:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 314 00000100:00100000:0.0:1788636741.785494:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 315 00000100:00100000:0.0:1788636741.785500:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207044992:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636741.785545:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2399:x1875521207044992:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 45us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636741.785552:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 315 00000100:00080000:3.0:1788636741.787023:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636741.787036:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788636742.053021:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636742.695984:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636742.696045:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207045120 00000100:00100000:2.0:1788636742.696055:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207045120 00000100:00100000:2.0:1788636742.696118:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 45 00000100:00100000:2.0:1788636742.696125:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:11127:x1875521207045120:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636742.696158:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636742.696184:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83855e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38fc1 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696240:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838565 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696251:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696270:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696294:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83856c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696301:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83856c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696307:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83856c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696387:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838565 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696395:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838565 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696402:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838565 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696408:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636742.696431:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838565 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696739:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838565 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696752:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636742.696754:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636742.696758:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838565 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696763:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838565 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696775:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83856c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696779:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83856c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696782:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83856c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696786:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636742.696788:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83856c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696791:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83856c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696795:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cf03a5ec500) 00010000:00010000:2.0:1788636742.696796:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636742.696804:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83856c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696836:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83856c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696873:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83855e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fc1 expref: 10 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696883:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636742.696886:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636742.696890:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83855e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fc1 expref: 10 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.696898:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1200, rc 0) 00000100:00100000:2.0:1788636742.696957:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:11127:x1875521207045120:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 832us (984us total) trans 0 rc 301/301 00000100:00100000:2.0:1788636742.696965:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 45 00000100:00100000:1.0:1788636742.720107:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636742.720203:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207045376 00000100:00100000:3.0:1788636742.720218:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207045376 00000100:00100000:3.0:1788636742.720295:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 46 00000100:00100000:3.0:1788636742.720309:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:11127:x1875521207045376:12345-192.168.202.26@tcp:36:lfs.0 00010000:00010000:3.0:1788636742.720410:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636742.720710:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e838518 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fac expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.720739:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:3.0:1788636742.720752:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636742.720892:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838573 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.720909:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838573 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.720920:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838573 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.720933:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.720941:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.720948:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722061:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722077:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722087:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636742.722103:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c41bded reply state 000000002d303e10 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722114:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722121:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:3.0:1788636742.722129:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788636742.722132:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788636742.722138:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788636742.722147:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838573 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722153:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838573 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722161:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838573 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722166:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636742.722170:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838573 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722178:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838573 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722187:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:3.0:1788636742.722189:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636742.722192:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838573 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722198:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838573 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636742.722211:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c41bded reply state 000000002d303e10 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722219:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.722236:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cef0331ca00) 00010000:00010000:3.0:1788636742.722238:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788636742.722241:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788636742.725665:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:11127:x1875521207045376:12345-192.168.202.26@tcp:36:lfs.0 Request processed in 5337us (5550us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788636742.725682:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 46 00000040:00080000:1.0:1788636742.741716:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788636742.805422:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226021632:0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.805499:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636742.805571:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226022144:0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.805600:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636742.805620:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226022656:0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.805641:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636742.805673:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788636742.805680:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226021504:0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.805705:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636742.805722:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226022016:0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.805743:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636742.805760:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226022528:0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.805791:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636742.805842:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226022144 00000100:00100000:3.0:1788636742.805850:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226022144 00000100:00100000:3.0:1788636742.805900:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226022656 00000100:00100000:3.0:1788636742.805903:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226022656 00000100:00100000:3.0:1788636742.805924:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788636742.805934:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226022144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.805998:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226022144:12345-0@lo:400:kworker.0 Request processed in 65us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636742.806007:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788636742.806026:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788636742.806033:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226022656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.806061:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226022656:12345-0@lo:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636742.806067:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788636742.806088:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226021632 00000100:00100000:3.0:1788636742.806091:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226021632 00000100:00100000:3.0:1788636742.806112:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226022016 00000100:00100000:3.0:1788636742.806115:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226022016 00000100:00100000:3.0:1788636742.806132:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226022528 00000100:00100000:3.0:1788636742.806135:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226022528 00000100:00100000:3.0:1788636742.806150:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788636742.806157:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226021632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.806186:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226021632:12345-0@lo:400:kworker.0 Request processed in 29us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636742.806192:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788636742.806204:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788636742.806210:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226022016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.806235:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226022016:12345-0@lo:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636742.806242:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788636742.806253:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788636742.806259:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226022528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.806295:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226022528:12345-0@lo:400:kworker.0 Request processed in 37us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636742.806302:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:3.0:1788636742.806322:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636742.806326:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636742.806328:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636742.806369:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0362f480 x1875521226022016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636742.806383:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226022016:0@lo:400:kworker.0 00010000:00080000:3.0:1788636742.806395:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0362ca80 x1875521226022528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636742.806404:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226022528:0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.806414:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226021632:0@lo:400:kworker.0 00010000:00080000:3.0:1788636742.806424:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0362e300 x1875521226022144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636742.806432:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226022144:0@lo:400:kworker.0 00000100:00100000:3.0:1788636742.806441:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226022656:0@lo:400:kworker.0 00000040:00080000:0.0:1788636742.807158:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788636742.807225:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226021376:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.807267:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636742.807294:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226021888:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.807314:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636742.807354:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226022400:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.807393:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636742.807415:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226022912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636742.807440:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636742.807461:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788636742.807467:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226021248:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.807492:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636742.807513:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226021760:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.807536:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636742.807554:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226022272:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.807576:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636742.807589:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226022784:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.807607:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636742.807643:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226022912 00000100:00100000:0.0:1788636742.807649:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226022912 00000100:00100000:0.0:1788636742.807706:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788636742.807713:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226022912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636742.807738:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636742.807776:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226022912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636742.807783:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788636742.807804:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226021504 00000100:00100000:0.0:1788636742.807830:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226021504 00000100:00100000:0.0:1788636742.807854:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226021760 00000100:00100000:0.0:1788636742.807857:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226021760 00000100:00100000:0.0:1788636742.807871:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788636742.807877:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226021504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.807915:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226021504:12345-0@lo:400:kworker.0 Request processed in 38us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636742.807921:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788636742.807931:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788636742.807936:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226021760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.807958:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226021760:12345-0@lo:400:kworker.0 Request processed in 22us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636742.807963:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788636742.807984:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226021376 00000100:00100000:0.0:1788636742.807987:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226021376 00000100:00100000:0.0:1788636742.808003:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226021888 00000100:00100000:0.0:1788636742.808005:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226021888 00000100:00100000:0.0:1788636742.808015:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226022400 00000100:00100000:0.0:1788636742.808018:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226022400 00000100:00100000:0.0:1788636742.808032:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788636742.808037:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226021376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.808077:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226021376:12345-0@lo:400:kworker.0 Request processed in 38us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636742.808083:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788636742.808095:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788636742.808100:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226021888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.808123:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226021888:12345-0@lo:400:kworker.0 Request processed in 23us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636742.808129:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788636742.808139:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788636742.808145:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226022400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.808169:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226022400:12345-0@lo:400:kworker.0 Request processed in 25us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636742.808174:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00080000:0.0:1788636742.808192:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636742.808195:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636742.808204:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226022272 00000100:00100000:0.0:1788636742.808207:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226022272 00000100:00100000:0.0:1788636742.808231:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226022784 00000100:00100000:0.0:1788636742.808234:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226022784 00000100:00100000:0.0:1788636742.808245:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788636742.808250:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226022272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.808277:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226022272:12345-0@lo:400:kworker.0 Request processed in 27us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636742.808283:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788636742.808292:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788636742.808297:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226022784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.808328:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226022784:12345-0@lo:400:kworker.0 Request processed in 31us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636742.808333:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1788636742.808359:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636742.808652:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226021760:0@lo:400:kworker.0 00010000:00080000:0.0:1788636742.808667:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0362dc00 x1875521226022272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636742.808679:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226022272:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.808689:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226022784:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.808698:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226021376:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.808707:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226021888:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.808716:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226022400:0@lo:400:kworker.0 00000100:00100000:0.0:1788636742.808730:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226022912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636742.808767:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226021504:0@lo:400:kworker.0 00000100:00100000:1.0:1788636742.812416:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226021248 00000100:00100000:1.0:1788636742.812427:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226021248 00000100:00100000:1.0:1788636742.812487:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788636742.812497:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226021248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636742.812587:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226021248:12345-0@lo:400:kworker.0 Request processed in 92us (5094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636742.812594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788636742.812632:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226023040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636742.812667:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636742.812733:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226021248:0@lo:400:kworker.0 00000100:00100000:1.0:1788636742.812757:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226023040 00000100:00100000:1.0:1788636742.812760:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226023040 00000100:00100000:1.0:1788636742.812785:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788636742.812791:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226023040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636742.812831:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636742.812865:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226023040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636742.812888:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788636742.813089:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226023040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636742.874048:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636742.874093:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207045504 00000100:00100000:3.0:1788636742.874103:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207045504 00000100:00100000:3.0:1788636742.874160:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 47 00000100:00100000:3.0:1788636742.874171:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:11135:x1875521207045504:12345-192.168.202.26@tcp:101:lctl.0 00010000:00010000:3.0:1788636742.874196:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636742.874257:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838588 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38fc8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.874334:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83858f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.874362:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83858f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.874374:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83858f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636742.874427:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788636742.874431:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636742.874470:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83858f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.874509:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990800/0x5b741ef42e838588 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fc8 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.874527:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83858f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fc8 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.874536:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:3.0:1788636742.874539:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636742.874543:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000031800, rc 0) 00000100:00100000:3.0:1788636742.874601:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:11135:x1875521207045504:12345-192.168.202.26@tcp:101:lctl.0 Request processed in 432us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636742.874608:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 47 00000100:00100000:1.0:1788636742.976103:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636742.977540:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207045632 00000100:00100000:2.0:1788636742.977555:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207045632 00000100:00100000:2.0:1788636742.977696:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 48 00000100:00100000:2.0:1788636742.977708:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:11141:x1875521207045632:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636742.977727:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636742.977750:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838596 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38fcf expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.977850:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83859d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.977887:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83859d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.977900:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83859d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.977913:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8385a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.977920:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8385a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.977927:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8385a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978014:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8385ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978023:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8385ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978031:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8385ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636742.978065:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788636742.978069:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636742.978104:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8385ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978117:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83859d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978146:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83859d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978153:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83859d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978159:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636742.978164:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83859d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978171:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83859d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978182:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:2.0:1788636742.978186:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636742.978191:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83859d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978197:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e83859d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978210:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8385a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978216:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8385a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978223:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8385a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978228:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636742.978237:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8385a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978244:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8385a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978253:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cef0331ca00) 00010000:00010000:2.0:1788636742.978255:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636742.978259:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8385a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978264:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8385a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978291:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838596 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fcf expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978305:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8385ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fcf expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.978312:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636742.978315:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788636742.978317:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0e00, rc 0) 00000100:00100000:2.0:1788636742.978402:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+12:11141:x1875521207045632:12345-192.168.202.26@tcp:101:bash.0 Request processed in 695us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636742.978409:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 48 00000100:00100000:1.0:1788636742.982735:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636742.983163:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207045888 00000100:00100000:2.0:1788636742.983173:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207045888 00000100:00100000:2.0:1788636742.983235:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 49 00000100:00100000:2.0:1788636742.983246:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+12:11141:x1875521207045888:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636742.983281:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636742.983302:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8385b2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38fd6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983424:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8385b9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983439:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8385b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983450:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8385b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983491:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983499:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983507:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636742.983775:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788636742.983939:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983946:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983951:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983983:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8385b9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983988:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8385b9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983993:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8385b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.983996:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636742.983999:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8385b9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.984004:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8385b9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.984011:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636742.984013:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636742.984017:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8385b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.984020:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8385b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636742.984030:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026b88c9b reply state 00000000825d2748 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.984038:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.984042:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cf03a5ec500) 00010000:00010000:2.0:1788636742.984047:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636742.984049:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788636742.984072:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8385b2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fd6 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.984084:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fd6 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.984091:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cf03a5ec800) 00010000:00010000:2.0:1788636742.984093:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636742.984095:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0800, rc 0) 00000100:00100000:2.0:1788636742.984163:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:11141:x1875521207045888:12345-192.168.202.26@tcp:101:bash.0 Request processed in 919us (1439us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788636742.984170:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 49 00000100:00100000:0.0:1788636742.990714:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636742.990801:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207046016 00000100:00100000:3.0:1788636742.990860:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207046016 00000100:00100000:3.0:1788636742.990901:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:3.0:1788636742.990910:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875521207046016:12345-192.168.202.26@tcp:8:bash.0 00010000:00080000:3.0:1788636742.990953:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:3.0:1788636742.990988:0:8436:0:(genops.c:1385:class_connect()) connect: client a3091a46-1ad5-4415-b7a7-5e4bfab40689, cookie 0x5b741ef42e8385d5 00002000:00100000:3.0:1788636742.991000:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a3091a46-1ad5-4415-b7a7-5e4bfab40689/ffff9cef03756000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788636742.991016:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788636742.991175:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788636742.991208:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9cef03755800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636742.991280:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2397:x1875521207046016:12345-192.168.202.26@tcp:8:bash.0 Request processed in 367us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636742.991287:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:1.0:1788636742.995018:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636742.995067:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207046144 00000100:00100000:2.0:1788636742.995079:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207046144 00000100:00100000:2.0:1788636742.995224:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 29 00000100:00100000:2.0:1788636742.995236:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:0:x1875521207046144:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636742.995254:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636742.995283:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e8385dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38fdd expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636742.995363:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788636742.995383:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1788636742.995388:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636742.995399:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e8385dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fdd expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.995442:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e8385dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fdd expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636742.995457:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1200, rc 0) 00000100:00100000:2.0:1788636742.995522:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:0:x1875521207046144:12345-192.168.202.26@tcp:101:bash.0 Request processed in 287us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636742.995528:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 29 00000100:00080000:0.0:1788636742.996074:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636742.999055:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636742.999166:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207046272 00000100:00100000:3.0:1788636742.999177:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207046272 00000100:00100000:3.0:1788636742.999330:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 30 00000100:00100000:3.0:1788636742.999374:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:11141:x1875521207046272:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636742.999395:0:9845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636742.999419:0:9845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38fe4 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.999544:0:9845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e8385dc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fdd expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.999554:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636742.999559:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636742.999565:0:9845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 8 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.999619:0:9845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e8385dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fdd expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636742.999633:0:9845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e8385dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fdd expref: 8 pid: 8438 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636742.999647:0:9845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9845:1875521226023168:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636742.999857:0:9845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0081fbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636743.004856:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636743.004922:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207046400 00000100:00100000:1.0:1788636743.004932:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207046400 00000100:00100000:0.0:1788636743.004947:0:9845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9845:1875521226023168:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636743.004971:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e8385dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fdd expref: 9 pid: 8438 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.004979:0:9845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 9 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.004996:0:9845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf015990800, rc 0) 00000100:00100000:1.0:1788636743.005018:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:1.0:1788636743.005026:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2401:x1875521207046400:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636743.005039:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636743.005060:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e8385dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fdd expref: 9 pid: 8438 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.005073:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e8385dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fdd expref: 9 pid: 8438 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636743.005117:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:11141:x1875521207046272:12345-192.168.202.26@tcp:101:bash.0 Request processed in 5777us (6076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636743.005153:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 30 00010000:00010000:1.0:1788636743.005165:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e8385dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fdd expref: 9 pid: 8438 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.005181:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636743.005185:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636743.005200:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.005211:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.005381:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636743.005397:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1875521226023296:192.168.202.26@tcp:105: 00000100:00100000:1.0:1788636743.005533:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e106c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636743.010430:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1875521226023296:192.168.202.26@tcp:105: 00010000:00010000:1.0:1788636743.010593:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636743.010668:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207046400:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 5640us (5820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636743.010679:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:0.0:1788636743.013034:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.013112:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207046656 00000100:00100000:3.0:1788636743.013130:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207046656 00000100:00100000:3.0:1788636743.013205:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:3.0:1788636743.013217:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:11141:x1875521207046656:12345-192.168.202.26@tcp:35:bash.0 00000100:00100000:3.0:1788636743.013758:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:11141:x1875521207046656:12345-192.168.202.26@tcp:35:bash.0 Request processed in 541us (730us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788636743.013765:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00080000:0.0:1788636743.013992:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636743.061093:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636743.139761:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.139901:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207046912 00000100:00100000:3.0:1788636743.139914:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207046912 00000100:00100000:3.0:1788636743.139996:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 50 00000100:00100000:3.0:1788636743.140007:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:11151:x1875521207046912:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636743.140035:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636743.140068:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0013a1800/0x5b741ef42e8385ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38feb expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636743.140269:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788636743.140435:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0013a1800/0x5b741ef42e8385ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38feb expref: 18 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.140453:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:3.0:1788636743.140456:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636743.140462:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0013a1800/0x5b741ef42e8385ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38feb expref: 18 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.140480:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0013a1800, rc 0) 00000100:00100000:3.0:1788636743.140558:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:11151:x1875521207046912:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 553us (810us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788636743.140566:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 50 00000100:00100000:2.0:1788636743.148641:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.148915:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207047168 00000100:00100000:3.0:1788636743.148929:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207047168 00000100:00100000:3.0:1788636743.149067:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:3.0:1788636743.149094:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:11151:x1875521207047168:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636743.149729:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:11151:x1875521207047168:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 647us (1098us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788636743.149740:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:1.0:1788636743.231791:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636743.232026:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207047296 00000100:00100000:2.0:1788636743.232043:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207047296 00000100:00100000:2.0:1788636743.232174:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 51 00000100:00100000:2.0:1788636743.232187:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:11157:x1875521207047296:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636743.232220:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636743.232271:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8385f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38ff2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.232374:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8385ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.232394:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8385ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.232414:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8385ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636743.232494:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788636743.232499:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636743.232530:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8385ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.232570:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8385f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ff2 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.232595:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8385ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ff2 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.232605:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636743.232609:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636743.232613:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1a00, rc 0) 00000100:00100000:2.0:1788636743.232719:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:11157:x1875521207047296:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 533us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636743.232729:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 51 00000100:00100000:1.0:1788636743.236274:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.236432:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207047552 00000100:00100000:3.0:1788636743.236444:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207047552 00000100:00100000:3.0:1788636743.236510:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:3.0:1788636743.236521:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:11157:x1875521207047552:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636743.236541:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636743.236578:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0013a1800/0x5b741ef42e838606 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef38ff9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.236696:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0013a0200/0x5b741ef42e83860d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.236710:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0013a0200/0x5b741ef42e83860d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.236722:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0013a0200/0x5b741ef42e83860d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636743.236733:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788636743.236869:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0013a1800/0x5b741ef42e838606 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ff9 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.236891:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0013a0200/0x5b741ef42e83860d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ff9 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.236900:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cf03a5ec800) 00010000:00010000:3.0:1788636743.236903:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636743.236906:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0013a0200, rc 0) 00000100:00100000:3.0:1788636743.236968:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:11157:x1875521207047552:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 449us (708us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788636743.236975:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:0.0:1788636743.240163:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.240264:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207047808 00000100:00100000:3.0:1788636743.240274:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207047808 00000100:00100000:3.0:1788636743.240346:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 53 00000100:00100000:3.0:1788636743.240356:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:11157:x1875521207047808:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636743.240399:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636743.240439:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e83861b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39000 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.240554:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838622 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.240569:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.240581:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636743.240595:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788636743.240709:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e83861b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39000 expref: 24 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.240727:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838622 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39000 expref: 23 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.240736:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cf03a5ec800) 00010000:00010000:3.0:1788636743.240739:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788636743.240742:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8200, rc 0) 00000100:00100000:3.0:1788636743.242524:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:11157:x1875521207047808:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 452us (654us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788636743.242539:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 53 00000100:00100000:1.0:1788636743.253155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636743.253257:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207047936 00000100:00100000:0.0:1788636743.253282:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207047936 00000100:00100000:0.0:1788636743.253380:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:0.0:1788636743.253393:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:2399:x1875521207047936:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636743.253415:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636743.253452:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0013a0200/0x5b741ef42e83860d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ff9 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.253478:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cf03a5ec800) 00010000:00010000:0.0:1788636743.253484:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636743.253775:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:2399:x1875521207047936:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 383us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636743.253784:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:1.0:1788636743.260332:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.260487:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207048064 00000100:00100000:3.0:1788636743.260500:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207048064 00000100:00100000:3.0:1788636743.260563:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 31 00000100:00100000:3.0:1788636743.260588:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207048064:12345-192.168.202.26@tcp:1:lfs.0 00010000:00010000:3.0:1788636743.260638:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.260660:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.260669:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788636743.260674:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636743.260679:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.260720:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.260735:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 7 pid: 9845 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636743.260752:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1875521226023424:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636743.260891:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf005ae56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636743.264799:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636743.264968:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207048192 00000100:00100000:1.0:1788636743.264978:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207048192 00002000:00100000:1.0:1788636743.265028:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9cef03655f80 x1875521207048192/t0(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:229/0 lens 504/0 e 0 to 0 dl 1788636754 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636743.265040:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef03655f80 with x1875521207048192 ext(0->12) 00010000:00010000:1.0:1788636743.265049:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 8 pid: 9845 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.265076:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 8 pid: 9845 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636743.265084:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cef03655f80 00000100:00100000:1.0:1788636743.265123:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 0 00000100:00100000:1.0:1788636743.265134:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207048192:12345-192.168.202.26@tcp:4:lfs.0 00000100:00100000:3.0:1788636743.266037:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1875521226023424:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636743.266071:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788636743.266980:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000100:00100000:1.0:1788636743.271430:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2401:x1875521207048192:12345-192.168.202.26@tcp:4:lfs.0 Request processed in 6280us (6623us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788636743.271511:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 0 00002000:00100000:1.0:1788636743.271527:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9cef03655f80 x1875521207048192/t4294967300(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:229/0 lens 504/448 e 0 to 0 dl 1788636754 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636743.271540:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef03655f80 with x1875521207048192 ext(0->12) 00010000:00010000:1.0:1788636743.271553:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 9 pid: 9845 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.271572:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 9 pid: 9845 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636743.271582:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cef03655f80 00000100:00100000:0.0:1788636743.275098:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636743.275377:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207048320 00000100:00100000:1.0:1788636743.275389:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207048320 00010000:00010000:1.0:1788636743.275443:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 9 pid: 9845 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636743.275522:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 53 00000100:00100000:1.0:1788636743.275536:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2400:x1875521207048320:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636743.275561:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788636743.275587:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788636743.275589:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788636743 00002000:00010000:1.0:1788636743.276237:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788636743 00002000:00010000:1.0:1788636743.276240:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788636743 00002000:00010000:1.0:1788636743.276242:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788636743.276252:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 9 pid: 9845 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.276270:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 9 pid: 9845 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.276301:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042931baf/0x5b741ef42e8385e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fe4 expref: 9 pid: 9845 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.276320:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636743.276326:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636743.276344:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.276356:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.276414:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636743.276472:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636743.276492:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04084a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2400:x1875521207048320:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 960us (1409us total) trans 0 rc 0/0 00010000:00010000:3.0:1788636743.276493:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636743.276501:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 53 00010000:00010000:3.0:1788636743.276522:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.276531:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.276541:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.276548:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636743.276554:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.276565:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.276581:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.276589:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029b8d715/0x5b741ef42e838630 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636743.276665:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207048064:12345-192.168.202.26@tcp:1:lfs.0 Request processed in 16078us (16342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636743.276675:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 31 00000100:00100000:2.0:1788636743.280901:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636743.280936:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207048576 00000100:00100000:1.0:1788636743.280948:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207048576 00000100:00100000:1.0:1788636743.281009:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 8 00000100:00100000:0.0:1788636743.281056:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11157:x1875521207048576:12345-192.168.202.26@tcp:35:lfs.0 00000004:00010000:0.0:1788636743.281125:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838622 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39000 expref: 22 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636743.281410:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788636743.281456:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788636743.281779:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788636743.282165:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.282191:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fd6 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.282200:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.282238:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fd6 expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.282255:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fd6 expref: 26 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636743.282418:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04086d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1875521226023552:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636743.282508:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf007de4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636743.286487:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636743.286503:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04086d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1875521226023552:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636743.286534:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636743.286586:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207048704 00000100:00100000:1.0:1788636743.286593:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207048704 00010000:00010000:1.0:1788636743.286633:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fd6 expref: 27 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636743.286668:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00100000:1.0:1788636743.286676:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:2400:x1875521207048704:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636743.286690:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636743.286695:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fd6 expref: 27 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.286704:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fd6 expref: 27 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.286722:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e8385c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fd6 expref: 27 pid: 6523 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.286734:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cf03a5ec800) 00010000:00010000:1.0:1788636743.286737:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.286752:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.286758:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636743.286778:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636743.286804:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636743.286866:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:2400:x1875521207048704:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 188us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636743.286874:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 54 00010000:00010000:0.0:1788636743.286902:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636743.287007:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788636743.287405:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788636743.287522:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04086d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1875521226023680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788636743.287584:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636743.287632:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636743.287663:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226023680 00000100:00100000:3.0:1788636743.287670:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226023680 00000100:00100000:3.0:1788636743.287711:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788636743.287721:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1875521226023680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788636743.287841:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1875521226023680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636743.287847:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788636743.287862:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04086d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1875521226023680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788636743.287996:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1788636743.288035:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04086d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1875521226023808:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788636743.288063:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636743.288086:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636743.288222:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226023808 00000100:00100000:1.0:1788636743.288226:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226023808 00000100:00100000:1.0:1788636743.288345:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788636743.288353:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1875521226023808:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788636743.288463:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6525:x1875521226023808:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (398us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788636743.288469:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788636743.288532:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04086d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1875521226023808:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788636743.288566:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788636743.288608:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.288618:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.288625:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.288632:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636743.288636:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.288645:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.288660:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cf03a5ec800) 00010000:00010000:0.0:1788636743.288663:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788636743.288669:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.288689:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838637 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788636743.288780:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788636743.289016:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788636743.289026:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412100218687ns, next at 413100217119ns, rc = 0 00000001:00080000:0.0:1788636743.289032:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788636743.289051:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cf03a5ec800) 00010000:00010000:0.0:1788636743.289054:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788636743.289065:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838622 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39000 expref: 30 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636743.289376:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:11157:x1875521207048576:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 8357us (8486us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788636743.289385:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 8 00000020:00080000:0.0:1788636743.289389:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788636743.291903:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.291974:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207048832 00000100:00100000:3.0:1788636743.291982:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207048832 00000100:00100000:3.0:1788636743.292030:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00100000:3.0:1788636743.292041:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:11157:x1875521207048832:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636743.292065:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636743.292085:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e83863e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39007 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.292134:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e83863e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39007 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.292144:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e83863e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39007 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.292161:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:3.0:1788636743.292177:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788636743.292181:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8000, rc 0) 00000100:00100000:3.0:1788636743.292244:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11157:x1875521207048832:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 199us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636743.292249:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00100000:2.0:1788636743.295610:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.295715:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207049088 00000100:00100000:3.0:1788636743.295724:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207049088 00000100:00100000:3.0:1788636743.295779:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 9 00000100:00100000:3.0:1788636743.295792:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11157:x1875521207049088:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636743.296228:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+31:11157:x1875521207049088:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 436us (626us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788636743.296248:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 9 00000100:00100000:1.0:1788636743.420015:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636743.426568:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207049344 00000100:00100000:2.0:1788636743.426591:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207049344 00000100:00100000:2.0:1788636743.426718:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00100000:2.0:1788636743.426731:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+31:11167:x1875521207049344:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636743.426784:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636743.426839:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838645 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3900e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636743.426977:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788636743.427120:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838645 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3900e expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.427138:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:2.0:1788636743.427142:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636743.427149:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838645 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3900e expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.427518:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1e00, rc 0) 00000100:00100000:2.0:1788636743.427736:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:11167:x1875521207049344:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1006us (7728us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1788636743.427747:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00100000:2.0:1788636743.443484:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.443926:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207049472 00000100:00100000:3.0:1788636743.443937:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207049472 00000100:00100000:3.0:1788636743.444010:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 56 00000100:00100000:3.0:1788636743.444021:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:11167:x1875521207049472:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:3.0:1788636743.444106:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838653 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444124:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838653 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444137:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838653 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444149:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83865a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444156:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83865a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444191:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83865a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444412:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444422:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444429:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636743.444572:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444587:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838653 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444594:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838653 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444721:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838653 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444728:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636743.444734:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838653 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444743:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838653 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444757:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:3.0:1788636743.444768:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636743.444774:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838653 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444781:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838653 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444796:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83865a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444802:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83865a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444924:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83865a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444930:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636743.444933:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83865a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444939:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83865a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444948:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cf03a5ec500) 00010000:00010000:3.0:1788636743.444950:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636743.444954:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83865a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444959:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83865a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444970:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444983:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444989:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.444995:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636743.444997:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.445004:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.445012:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:3.0:1788636743.445014:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636743.445017:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.445022:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838661 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636743.445189:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:11167:x1875521207049472:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 1166us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636743.445199:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 56 00000100:00100000:0.0:1788636743.452940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636743.453246:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207049728 00000100:00100000:2.0:1788636743.453262:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207049728 00000100:00100000:2.0:1788636743.453350:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:2.0:1788636743.453365:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:11167:x1875521207049728:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:2.0:1788636743.454066:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+33:11167:x1875521207049728:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 700us (1137us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788636743.454074:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:1.0:1788636743.541760:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.542102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207049984 00000100:00100000:3.0:1788636743.542117:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207049984 00000100:00100000:3.0:1788636743.542207:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:3.0:1788636743.542220:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+33:11170:x1875521207049984:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636743.542269:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636743.542319:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838668 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39015 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.542626:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83866f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.542645:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83866f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.542660:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83866f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.542674:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838676 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.542681:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636743.542687:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549539:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549567:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549581:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636743.549611:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788636743.549733:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83866f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549761:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83866f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549768:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83866f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549774:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636743.549779:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83866f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549787:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83866f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549801:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636743.549804:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636743.549828:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83866f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549834:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e83866f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549851:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549856:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838676 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549862:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549867:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636743.549876:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549883:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838676 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549892:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cf03a5ec500) 00010000:00010000:0.0:1788636743.549894:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636743.549897:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838676 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549903:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549956:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838668 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39015 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549970:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39015 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636743.549977:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:0.0:1788636743.549979:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636743.549982:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7a00, rc 0) 00000100:00100000:0.0:1788636743.550068:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+35:11170:x1875521207049984:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 7850us (8322us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788636743.554853:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:0.0:1788636743.555964:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636743.556058:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207050112 00000100:00100000:2.0:1788636743.556093:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207050112 00000100:00100000:2.0:1788636743.556154:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00100000:2.0:1788636743.556165:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+35:11170:x1875521207050112:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:2.0:1788636743.556407:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83868b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.556427:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83868b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.556453:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83868b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.556494:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83868b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.556501:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83868b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.556508:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83868b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.556515:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636743.556520:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83868b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.556529:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83868b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.556544:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636743.556547:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636743.556552:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83868b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636743.556572:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83868b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636743.556972:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+35:11170:x1875521207050112:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 806us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636743.556980:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00100000:0.0:1788636743.569148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636743.569413:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207050368 00000100:00100000:3.0:1788636743.569428:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207050368 00000100:00100000:3.0:1788636743.569520:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:3.0:1788636743.569535:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+35:11170:x1875521207050368:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636743.570049:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:11170:x1875521207050368:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 513us (911us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788636743.570058:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:1.0:1788636744.004291:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636744.004398:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207050624 00000100:00100000:0.0:1788636744.004409:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207050624 00000100:00100000:0.0:1788636744.004490:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:0.0:1788636744.004501:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:11201:x1875521207050624:12345-192.168.202.26@tcp:101:cat.0 00010000:00010000:0.0:1788636744.004528:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636744.004549:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838692 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3901c expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.004666:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838699 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.004680:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.004693:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636744.004704:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788636744.004878:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3901c expref: 39 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.004897:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3901c expref: 38 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.004905:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:0.0:1788636744.004907:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636744.004911:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6000, rc 0) 00000100:00100000:0.0:1788636744.004970:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:11201:x1875521207050624:12345-192.168.202.26@tcp:101:cat.0 Request processed in 470us (691us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788636744.004978:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:1.0:1788636744.009939:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636744.009993:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636744.010096:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207050752 00000100:00100000:3.0:1788636744.010107:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207050752 00000100:00100000:3.0:1788636744.010179:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 4 00000100:00100000:3.0:1788636744.010205:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:2399:x1875521207050752:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636744.010222:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636744.010258:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838699 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3901c expref: 38 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.010286:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00000100:00100000:0.0:1788636744.010290:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207051008 00010000:00010000:3.0:1788636744.010291:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636744.010300:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207051008 00000100:00100000:0.0:1788636744.010348:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:3.0:1788636744.010356:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:2399:x1875521207050752:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 154us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636744.010356:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:11201:x1875521207051008:12345-192.168.202.26@tcp:35:cat.0 00000100:00100000:3.0:1788636744.010363:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 4 00000100:00100000:0.0:1788636744.010557:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:11201:x1875521207051008:12345-192.168.202.26@tcp:35:cat.0 Request processed in 201us (563us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788636744.010565:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 12 00010000:00010000:2.0:1788636744.089988:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636744.124572:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636744.124778:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207051264 00000100:00100000:0.0:1788636744.124789:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207051264 00000100:00100000:0.0:1788636744.124890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:0.0:1788636744.124900:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:11207:x1875521207051264:12345-192.168.202.26@tcp:101:dd.0 00010000:00010000:0.0:1788636744.124928:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636744.124931:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788636744.124957:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8385ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ff2 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.124980:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636744.124985:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636744.125001:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8386a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39023 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.125132:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.125149:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39015 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.125160:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.125222:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39015 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.125235:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39015 expref: 38 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636744.125249:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04087100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226023936:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636744.125365:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf007de4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636744.136214:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04087100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226023936:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636744.136259:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636744.156058:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636744.156375:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207051392 00000100:00100000:3.0:1788636744.156386:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207051392 00010000:00010000:3.0:1788636744.156449:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39015 expref: 39 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636744.156499:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00100000:3.0:1788636744.156510:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+39:2401:x1875521207051392:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636744.156527:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636744.156535:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39015 expref: 39 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.156549:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39015 expref: 39 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.156573:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e83867d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39015 expref: 39 pid: 6521 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.156609:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:3.0:1788636744.156613:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.156622:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.156629:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.156678:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636744.156759:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:2401:x1875521207051392:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 249us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636744.156767:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 55 00010000:00010000:0.0:1788636744.157195:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.157206:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636744.157233:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788636744.157475:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8386a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39023 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.157495:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39023 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.157503:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:0.0:1788636744.157507:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788636744.157522:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7000, rc 0) 00000100:00100000:0.0:1788636744.157581:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:11207:x1875521207051264:12345-192.168.202.26@tcp:101:dd.0 Request processed in 32682us (33020us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788636744.157589:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:1.0:1788636744.161103:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636744.161299:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207051520 00000100:00100000:2.0:1788636744.161312:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207051520 00000100:00100000:2.0:1788636744.161380:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:2.0:1788636744.161390:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:11207:x1875521207051520:12345-192.168.202.26@tcp:101:dd.0 00010000:00010000:2.0:1788636744.161417:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636744.161439:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3902a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.161476:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.161491:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.161503:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.161862:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3902a expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.161884:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3902a expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.161901:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636744.161904:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788636744.161908:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0a00, rc 0) 00000100:00100000:2.0:1788636744.162040:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+39:11207:x1875521207051520:12345-192.168.202.26@tcp:101:dd.0 Request processed in 650us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636744.162048:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:0.0:1788636744.172742:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636744.172862:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207051776 00000100:00100000:2.0:1788636744.172873:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207051776 00000100:00100000:2.0:1788636744.172934:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:2.0:1788636744.172944:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+39:11207:x1875521207051776:12345-192.168.202.26@tcp:36:dd.0 00010000:00010000:2.0:1788636744.173196:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.173212:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.173222:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788636744.173262:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788636744.173288:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f147a966 reply state 00000000e8519a9a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.173301:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.173310:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636744.173313:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636744.173342:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636744.173467:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+42:11207:x1875521207051776:12345-192.168.202.26@tcp:36:dd.0 Request processed in 523us (735us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788636744.173474:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 62 00000020:00080000:2.0:1788636744.173479:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788636744.560880:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636744.561402:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207051904 00000100:00100000:2.0:1788636744.561421:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207051904 00000100:00100000:2.0:1788636744.561538:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:2.0:1788636744.561554:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+42:11221:x1875521207051904:12345-192.168.202.26@tcp:101:stat.0 00010000:00010000:2.0:1788636744.561598:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636744.561952:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39031 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.562089:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8386d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.562114:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8386d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.562135:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8386d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.562150:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8386df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.562160:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8386df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.562167:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8386df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.563016:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.563055:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39023 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.563065:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.563106:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39023 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.563136:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39023 expref: 43 pid: 6521 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636744.563156:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226024064:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636744.563309:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef0219b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636744.566607:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226024064:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636744.566642:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636744.571374:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636744.571629:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207052160 00000100:00100000:3.0:1788636744.571641:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207052160 00000100:00100000:3.0:1788636744.571716:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:3.0:1788636744.571726:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+44:6171:x1875521207052160:12345-192.168.202.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788636744.572083:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+45:6171:x1875521207052160:12345-192.168.202.26@tcp:35:ldlm_bl.0 Request processed in 358us (719us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788636744.572092:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:1.0:1788636744.582724:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636744.583424:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207052288 00000100:00100000:0.0:1788636744.583508:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207052288 00010000:00010000:0.0:1788636744.583558:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39023 expref: 45 pid: 6521 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636744.583663:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 56 00000100:00100000:0.0:1788636744.583673:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+45:2400:x1875521207052288:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636744.583689:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636744.583696:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39023 expref: 45 pid: 6521 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.583710:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39023 expref: 45 pid: 6521 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.583735:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8386ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39023 expref: 45 pid: 6521 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.583752:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:0.0:1788636744.583757:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.583785:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.583793:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636744.583874:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636744.583940:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+44:2400:x1875521207052288:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 268us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636744.583948:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 56 00010000:00010000:2.0:1788636744.584019:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584030:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636744.584094:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788636744.584098:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636744.584159:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584182:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584192:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8386d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584198:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8386d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584204:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8386d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584210:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636744.584214:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8386d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584223:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8386d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584580:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636744.584585:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636744.584590:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8386d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584597:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8386d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584612:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8386df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584617:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8386df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584630:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8386df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584635:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636744.584638:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8386df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584644:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8386df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584652:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cf03a5ec500) 00010000:00010000:2.0:1788636744.584654:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636744.584657:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8386df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584662:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e8386df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584771:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39031 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584787:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39031 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.584795:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636744.584797:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636744.584799:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0600, rc 0) 00000100:00100000:2.0:1788636744.584867:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+43:11221:x1875521207051904:12345-192.168.202.26@tcp:101:stat.0 Request processed in 23316us (24060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636744.584884:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:0.0:1788636744.705319:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636744.705621:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207052544 00000100:00100000:2.0:1788636744.705632:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207052544 00000100:00100000:2.0:1788636744.705698:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:2.0:1788636744.705710:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+43:11227:x1875521207052544:12345-192.168.202.26@tcp:36:truncate.0 00010000:00010000:2.0:1788636744.705789:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636744.705843:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8386e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39031 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.705863:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636744.705868:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636744.707826:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.707850:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.707863:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788636744.707907:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788636744.707930:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b26b9bdb reply state 00000000719c7ce8 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.707943:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636744.707952:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636744.707954:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636744.707973:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636744.708137:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+45:11227:x1875521207052544:12345-192.168.202.26@tcp:36:truncate.0 Request processed in 2419us (2820us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788636744.708147:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 64 00000020:00080000:2.0:1788636744.708152:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788636744.968393:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636744.968564:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207052672 00000100:00100000:3.0:1788636744.968578:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207052672 00000100:00100000:3.0:1788636744.968717:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 65 00000100:00100000:3.0:1788636744.968730:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+45:11241:x1875521207052672:12345-192.168.202.26@tcp:101:stat.0 00010000:00010000:3.0:1788636744.968760:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636744.968796:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8386f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39038 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.968938:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8386fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.968955:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8386fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.968967:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8386fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.968978:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838702 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.968986:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.968991:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969073:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969083:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969089:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636744.969138:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788636744.969143:0:13298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636744.969169:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969188:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969197:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8386fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969204:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8386fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969211:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8386fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969217:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636744.969222:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8386fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969230:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8386fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969243:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:3.0:1788636744.969247:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636744.969253:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8386fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969274:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8386fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969291:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838702 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969297:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838702 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969310:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838702 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969315:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636744.969318:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838702 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969325:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838702 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969345:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cf03a5ec500) 00010000:00010000:3.0:1788636744.969348:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636744.969352:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838702 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969358:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838702 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969388:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8386f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39038 expref: 47 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969401:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39038 expref: 46 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636744.969408:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:3.0:1788636744.969410:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636744.969412:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8800, rc 0) 00000100:00100000:3.0:1788636744.969488:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+46:11241:x1875521207052672:12345-192.168.202.26@tcp:101:stat.0 Request processed in 759us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636744.969507:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 65 00010000:00010000:3.0:1788636745.109368:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636745.124310:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636745.124868:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207052928 00000100:00100000:2.0:1788636745.124886:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207052928 00000100:00100000:2.0:1788636745.124991:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 66 00000100:00100000:2.0:1788636745.125005:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+46:11251:x1875521207052928:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636745.125034:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636745.125065:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838710 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3903f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636745.125214:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788636745.125417:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838710 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3903f expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.126068:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:2.0:1788636745.126081:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636745.126091:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838710 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3903f expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.126114:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1e00, rc 0) 00000100:00080000:0.0:1788636745.126317:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636745.126760:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+47:11251:x1875521207052928:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1755us (2464us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788636745.126771:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 66 00000001:00080000:1.0:1788636745.128688:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000004:00080000:1.0:1788636745.128726:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788636745.128744:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf026b086c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788636745.128749:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf009107000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf026b08a80 00000020:00080000:1.0:1788636745.128753:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf009107400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf002f2be00 00000020:00080000:1.0:1788636745.128846:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1788636745.129403:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226024192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788636745.129500:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636745.129598:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226024192 00000100:00100000:0.0:1788636745.129918:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226024192 00000100:00100000:0.0:1788636745.129996:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788636745.130007:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875521226024192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788636745.130047:0:8438:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00000020:00080000:1.0:1788636745.130208:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1788636745.130224:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130263:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130271:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130277:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636745.130283:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130293:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130318:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cef0331ca00) 00010000:00010000:2.0:1788636745.130322:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636745.130347:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130356:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990400/0x5b741ef42e83857a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130387:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130394:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130401:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130407:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015991200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636745.130417:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130424:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130433:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636745.130436:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636745.130439:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130446:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015991200/0x5b741ef42e838581 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130466:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130473:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130480:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130484:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636745.130489:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130495:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130504:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cf03a5ec500) 00010000:00010000:2.0:1788636745.130506:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636745.130516:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130523:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8385c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130544:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130550:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130556:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130562:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636745.130566:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130572:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130581:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636745.130584:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636745.130587:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130592:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8386ca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.130603:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788636745.130847:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c6e47, atime: 0x6a9c6e47, ctime: 0x6a9c6e47, blocks: 0x8 00010000:00010000:0.0:1788636745.130857:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d6c06ae/0x5b741ef42e83871e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.130875:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=413s v=(0 0) 00010000:00010000:0.0:1788636745.130882:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636745.130889:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d6c06ae/0x5b741ef42e83871e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.130919:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d6c06ae/0x5b741ef42e83871e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.130930:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d6c06ae/0x5b741ef42e83871e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.130938:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d6c06ae/0x5b741ef42e83871e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.130975:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636745.131306:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636745.131320:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d6c06ae/0x5b741ef42e83871e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.131346:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636745.131353:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d6c06ae/0x5b741ef42e83871e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.131366:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d6c06ae/0x5b741ef42e83871e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.131390:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d6c06ae/0x5b741ef42e83871e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.131398:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d6c06ae/0x5b741ef42e83871e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.131425:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636745.131427:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636745.131437:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636745.131556:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.131571:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.131577:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636745.131581:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.131589:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.131601:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636745.131603:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636745.131670:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.131679:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8386ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788636745.131940:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636745.134047:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1875521226024192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4027us (4532us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788636745.134073:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:1.0:1788636745.143702:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf03fcadf80/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788636745.143728:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226024192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788636745.147229:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.147455:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207053184 00000100:00100000:3.0:1788636745.147469:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207053184 00000100:00100000:3.0:1788636745.147549:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00100000:3.0:1788636745.147561:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+12:11251:x1875521207053184:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636745.148325:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:11251:x1875521207053184:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 760us (1106us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788636745.148348:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00100000:2.0:1788636745.209259:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636745.209440:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207053440 00000100:00100000:1.0:1788636745.209453:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207053440 00000100:00100000:1.0:1788636745.209529:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:1.0:1788636745.209543:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:11257:x1875521207053440:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:1.0:1788636745.209578:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636745.209606:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36000/0x5b741ef42e838725 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39046 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.209771:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.209790:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39038 expref: 14 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.209799:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.209910:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39038 expref: 14 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.209929:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39038 expref: 14 pid: 13298 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636745.209947:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf040993480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1875521226024320:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636745.210083:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636745.216761:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf040993480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1875521226024320:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636745.216881:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636745.219963:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636745.221862:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207053568 00000100:00100000:1.0:1788636745.221883:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207053568 00010000:00010000:1.0:1788636745.221960:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39038 expref: 15 pid: 13298 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636745.222098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:1.0:1788636745.222112:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:2401:x1875521207053568:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636745.222138:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636745.222147:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39038 expref: 15 pid: 13298 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.222165:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39038 expref: 15 pid: 13298 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.222212:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838709 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39038 expref: 15 pid: 13298 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.222241:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:1.0:1788636745.222248:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.222261:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.222270:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.222348:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636745.222445:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:2401:x1875521207053568:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 335us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636745.222454:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 57 00010000:00010000:2.0:1788636745.223392:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.223406:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636745.223443:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788636745.223645:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36000/0x5b741ef42e838725 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39046 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.223689:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39046 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.223699:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636745.223702:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636745.223706:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36200, rc 0) 00000100:00100000:2.0:1788636745.224005:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:11257:x1875521207053440:12345-192.168.202.26@tcp:101:bash.0 Request processed in 14464us (14765us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788636745.224016:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:2.0:1788636745.227092:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.227219:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207053824 00000100:00100000:3.0:1788636745.227234:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207053824 00000100:00100000:3.0:1788636745.227319:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 68 00000100:00100000:3.0:1788636745.227347:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:11257:x1875521207053824:12345-192.168.202.26@tcp:36:bash.0 00010000:00010000:3.0:1788636745.227732:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.227755:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.227772:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636745.228242:0:13298:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1788636745.228275:0:13298:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ba26d8b reply state 0000000008f494c4 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.228291:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.228339:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:3.0:1788636745.228343:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788636745.228349:0:13298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636745.228530:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:11257:x1875521207053824:12345-192.168.202.26@tcp:36:bash.0 Request processed in 1195us (1452us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788636745.228540:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 68 00000020:00080000:3.0:1788636745.228547:0:13298:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788636745.234777:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636745.234961:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207053952 00000100:00100000:2.0:1788636745.234973:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207053952 00000100:00100000:2.0:1788636745.235054:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:2.0:1788636745.235147:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:11257:x1875521207053952:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636745.235194:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636745.235231:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838741 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3904d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.235389:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.235410:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39046 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.235424:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.235598:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39046 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.235616:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39046 expref: 18 pid: 6522 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636745.235633:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226024448:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636745.235921:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef0219bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636745.241580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636745.241707:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207054080 00000100:00100000:1.0:1788636745.241721:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207054080 00010000:00010000:1.0:1788636745.241782:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39046 expref: 19 pid: 6522 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636745.241880:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00100000:1.0:1788636745.241894:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:2400:x1875521207054080:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636745.241918:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636745.241927:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39046 expref: 19 pid: 6522 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.241945:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39046 expref: 19 pid: 6522 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.241981:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:1.0:1788636745.241988:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.242001:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.242010:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.242081:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636745.242159:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:2400:x1875521207054080:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 267us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636745.242168:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 58 00010000:00010000:0.0:1788636745.243658:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e83872c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39046 expref: 18 pid: 6522 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636745.243685:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226024448:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636745.243715:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.243725:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.243731:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636745.243900:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788636745.243906:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636745.243941:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.243984:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838741 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3904d expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.244004:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3904d expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.244014:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:0.0:1788636745.244018:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636745.244022:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1e00, rc 0) 00000100:00100000:0.0:1788636745.244120:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:11257:x1875521207053952:12345-192.168.202.26@tcp:101:bash.0 Request processed in 9045us (9349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636745.244131:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:2.0:1788636745.249084:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636745.249307:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207054336 00000100:00100000:0.0:1788636745.249320:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207054336 00000100:00100000:0.0:1788636745.249409:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 15 00000100:00100000:0.0:1788636745.249422:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:11257:x1875521207054336:12345-192.168.202.26@tcp:35:bash.0 00000100:00100000:0.0:1788636745.250084:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:11257:x1875521207054336:12345-192.168.202.26@tcp:35:bash.0 Request processed in 661us (1025us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788636745.250094:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 15 00000100:00100000:0.0:1788636745.316496:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636745.316751:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207054592 00000100:00100000:2.0:1788636745.316765:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207054592 00000100:00100000:2.0:1788636745.316877:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:2.0:1788636745.316889:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:11267:x1875521207054592:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636745.316932:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636745.316961:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e83874f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39054 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636745.317114:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788636745.317247:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e83874f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39054 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.317268:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:2.0:1788636745.317272:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636745.317280:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e83874f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39054 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.317337:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1400, rc 0) 00000100:00100000:2.0:1788636745.317415:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:11267:x1875521207054592:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 529us (936us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788636745.317422:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:2.0:1788636745.320835:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.320956:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207054720 00000100:00100000:3.0:1788636745.320968:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207054720 00000100:00100000:3.0:1788636745.321028:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:3.0:1788636745.321037:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:11267:x1875521207054720:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:3.0:1788636745.321220:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e83875d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.321242:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e83875d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.321258:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e83875d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.321279:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838764 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.321286:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838764 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.321294:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838764 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.321420:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.321448:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.321453:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788636745.325661:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325713:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e83875d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325719:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e83875d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325726:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e83875d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325730:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636745.325734:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e83875d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325740:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e83875d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325758:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636745.325761:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636745.325765:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e83875d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325770:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e83875d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325790:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838764 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325794:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838764 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325798:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838764 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325817:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636745.325820:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838764 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325824:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838764 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325829:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0331c300) 00010000:00010000:0.0:1788636745.325830:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636745.325832:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838764 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325836:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838764 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325856:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325861:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325865:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325867:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636745.325869:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325872:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325883:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:0.0:1788636745.325885:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636745.325887:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.325890:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e83876b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636745.326233:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:11267:x1875521207054720:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 5189us (5423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636745.326244:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:0.0:1788636745.328620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636745.328728:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207054976 00000100:00100000:2.0:1788636745.328740:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207054976 00000100:00100000:2.0:1788636745.328852:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:2.0:1788636745.328862:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:11267:x1875521207054976:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:2.0:1788636745.329165:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:11267:x1875521207054976:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 303us (553us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788636745.329175:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:2.0:1788636745.361068:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636745.361408:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207055232 00000100:00100000:0.0:1788636745.361423:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207055232 00000100:00100000:0.0:1788636745.361889:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 72 00000100:00100000:0.0:1788636745.361901:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:11270:x1875521207055232:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636745.361936:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636745.361965:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838772 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3905b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362070:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838779 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362090:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362106:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362156:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838780 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362162:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362167:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362360:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838787 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362371:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362378:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636745.362391:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788636745.362574:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838779 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362581:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838779 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362586:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838779 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362590:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636745.362593:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838779 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362611:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838779 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362671:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636745.362674:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636745.362679:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838779 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362684:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838779 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362698:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838780 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362702:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838780 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362706:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362709:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636745.362710:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838780 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362714:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838780 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362718:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef021c6700) 00010000:00010000:0.0:1788636745.362719:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636745.362721:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838780 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362732:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838780 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362780:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838772 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3905b expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362791:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3905b expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.362797:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:0.0:1788636745.362799:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636745.362800:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6000, rc 0) 00000100:00100000:0.0:1788636745.363207:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11270:x1875521207055232:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1307us (2150us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788636745.363218:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 72 00000100:00100000:1.0:1788636745.365112:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226024576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636745.366447:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636745.366756:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226024704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636745.367680:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636745.367899:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226024704 00000100:00100000:0.0:1788636745.367920:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226024704 00000100:00100000:0.0:1788636745.367987:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788636745.367997:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226024704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636745.368049:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636745.368111:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226024704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636745.368119:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788636745.368309:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226024704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636745.368794:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.368872:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.368929:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226024832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636745.368980:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636745.369042:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207055488 00000100:00100000:3.0:1788636745.369048:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207055488 00000100:00100000:3.0:1788636745.369586:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 5 00000100:00100000:3.0:1788636745.369598:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:2400:x1875521207055488:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636745.369616:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636745.369649:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838787 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3905b expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.369678:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:3.0:1788636745.369685:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636745.369743:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:2400:x1875521207055488:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 147us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636745.369751:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 5 00000100:00100000:3.0:1788636745.369780:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226024576 00000100:00100000:3.0:1788636745.369785:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226024576 00000100:00100000:1.0:1788636745.371151:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226024832 00000100:00100000:1.0:1788636745.371173:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226024832 00000100:00100000:1.0:1788636745.371221:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788636745.371235:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226024576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636745.371303:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788636745.371441:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226024576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (4991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636745.371450:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788636745.371471:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788636745.371479:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875521226024832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636745.371490:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788636745.371527:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875521226024832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (2546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636745.371533:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1788636745.371554:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636745.371640:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226024832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636745.371791:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226024576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636745.371955:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207055360 00000100:00100000:2.0:1788636745.371962:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207055360 00000100:00100000:2.0:1788636745.372038:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 73 00000100:00100000:2.0:1788636745.372048:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:11270:x1875521207055360:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:2.0:1788636745.372168:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838795 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.372203:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.372259:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.372337:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.372346:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838795 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.372355:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.372362:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636745.372369:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.372379:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838795 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.372396:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636745.372400:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636745.372407:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838795 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.372417:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838795 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636745.372521:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:11270:x1875521207055360:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 474us (3730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636745.372528:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 73 00000100:00100000:2.0:1788636745.376040:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.376565:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207055744 00000100:00100000:3.0:1788636745.376583:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207055744 00000100:00100000:3.0:1788636745.376708:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:3.0:1788636745.376723:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:11270:x1875521207055744:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636745.377209:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11270:x1875521207055744:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 486us (1187us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788636745.377220:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:1.0:1788636745.518064:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636745.518548:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207056000 00000100:00100000:0.0:1788636745.518564:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207056000 00000100:00100000:0.0:1788636745.518721:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 74 00000100:00100000:0.0:1788636745.518734:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11288:x1875521207056000:12345-192.168.202.26@tcp:101:cat.0 00010000:00010000:0.0:1788636745.518771:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636745.518799:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e83879c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39062 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.519007:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.519028:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.519044:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636745.519058:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788636745.519489:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e83879c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39062 expref: 25 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.519515:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39062 expref: 24 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.519525:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:0.0:1788636745.519528:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788636745.519533:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7000, rc 0) 00000100:00100000:0.0:1788636745.519635:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11288:x1875521207056000:12345-192.168.202.26@tcp:101:cat.0 Request processed in 902us (1586us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788636745.519643:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 74 00000100:00100000:1.0:1788636745.550136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636745.550267:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207056128 00000100:00100000:0.0:1788636745.550304:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207056128 00000100:00100000:0.0:1788636745.550416:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 75 00000100:00100000:0.0:1788636745.550441:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11289:x1875521207056128:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636745.550484:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636745.550520:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e8387b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39069 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.550650:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e8387b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.550673:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e8387b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.550696:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e8387b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636745.550763:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788636745.550767:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636745.550795:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e8387b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.550872:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e8387b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39069 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.550899:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e8387b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39069 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.550910:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636745.550914:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636745.550919:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7400, rc 0) 00000100:00100000:0.0:1788636745.551017:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11289:x1875521207056128:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 589us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636745.551026:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 75 00000100:00100000:3.0:1788636745.560551:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636745.560772:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207056512 00000100:00100000:2.0:1788636745.560785:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207056512 00000100:00100000:2.0:1788636745.560883:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:2.0:1788636745.560893:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11289:x1875521207056512:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:2.0:1788636745.561435:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:11289:x1875521207056512:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 538us (899us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788636745.561447:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:1.0:1788636745.565042:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.565207:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207056640 00000100:00100000:3.0:1788636745.565228:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207056640 00000100:00100000:3.0:1788636745.565321:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:3.0:1788636745.565343:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:11289:x1875521207056640:12345-192.168.202.26@tcp:103:lfs.0 00010000:00010000:3.0:1788636745.565364:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788636745.565396:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838748 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3904d expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.565421:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39062 expref: 25 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.565440:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e83863e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39007 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.565451:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:3.0:1788636745.565456:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636745.565545:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:11289:x1875521207056640:12345-192.168.202.26@tcp:103:lfs.0 Request processed in 205us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636745.565554:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:1.0:1788636745.568499:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.568693:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207056768 00000100:00100000:3.0:1788636745.568725:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207056768 00000100:00100000:3.0:1788636745.568791:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 76 00000100:00100000:3.0:1788636745.568799:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:11289:x1875521207056768:12345-192.168.202.26@tcp:58:lfs.0 00010000:00010000:3.0:1788636745.568988:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8387bf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.569007:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8387bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.569020:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8387bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636745.569746:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636745.570047:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788636745.570199:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788636745.570584:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:11289:x1875521207056768:12345-192.168.202.26@tcp:58:lfs.0 Request processed in 1769us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636745.570599:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 76 00000100:00100000:2.0:1788636745.596715:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636745.597027:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207056896 00000100:00100000:0.0:1788636745.597044:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207056896 00000100:00100000:0.0:1788636745.597131:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 77 00000100:00100000:0.0:1788636745.597143:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:11291:x1875521207056896:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636745.597175:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636745.597206:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e8387c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39070 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597491:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597514:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597528:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597543:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597549:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597553:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597674:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597796:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597802:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636745.597897:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788636745.597901:0:13298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636745.597920:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597931:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597939:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597944:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597948:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597952:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636745.597955:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597963:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597973:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636745.597981:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636745.597986:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.597991:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.598003:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.598006:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.598010:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.598013:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636745.598015:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.598018:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.598022:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef021c6700) 00010000:00010000:0.0:1788636745.598023:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636745.598025:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.598028:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.598058:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e8387c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39070 expref: 25 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.598571:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39070 expref: 24 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.598580:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:0.0:1788636745.598582:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636745.598586:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7000, rc 0) 00000100:00100000:0.0:1788636745.598749:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11291:x1875521207056896:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1548us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636745.598757:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 77 00000040:00080000:1.0:1788636745.814020:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636745.814034:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636745.814310:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788636745.814321:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636745.815367:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04084a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226024960:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788636745.816422:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10840 going to sleep for 11 seconds 00000100:00100000:1.0:1788636745.829138:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04084a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226024960:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788636745.833574:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.833968:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207057024 00000100:00100000:3.0:1788636745.833985:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207057024 00000100:00100000:3.0:1788636745.834074:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 78 00000100:00100000:3.0:1788636745.834089:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11302:x1875521207057024:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788636745.834147:0:11089:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788636745.834581:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11302:x1875521207057024:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 493us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636745.834591:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 78 00000100:00100000:3.0:1788636745.851850:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636745.852366:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207057152 00000100:00100000:2.0:1788636745.852382:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207057152 00000100:00100000:2.0:1788636745.852468:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 79 00000100:00100000:2.0:1788636745.852481:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11302:x1875521207057152:12345-192.168.202.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788636745.852595:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8387e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.852617:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8387e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.852634:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8387e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860095:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8387e9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860125:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8387e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860141:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8387e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860208:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860218:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860225:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636745.860283:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788636745.860288:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636745.860306:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860321:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8387e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860340:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8387e2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860348:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8387e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860355:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636745.860361:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8387e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860371:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8387e2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860386:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:2.0:1788636745.860396:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636745.860402:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8387e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860409:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8387e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860428:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8387e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860435:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8387e9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860570:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8387e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860577:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636745.860581:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8387e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860588:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8387e9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860597:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9cf03a5ec500) 00010000:00010000:2.0:1788636745.860600:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636745.860603:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8387e9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860609:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e8387e9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860627:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860640:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860647:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860653:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636745.860656:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860662:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860671:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636745.860674:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636745.860677:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636745.860683:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8387f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636745.861394:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11302:x1875521207057152:12345-192.168.202.26@tcp:34:lhsmtool_posix.0 Request processed in 8909us (9600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636745.861407:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 79 00000100:00100000:3.0:1788636745.873238:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636745.873653:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207057408 00000100:00100000:0.0:1788636745.873669:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207057408 00000100:00100000:0.0:1788636745.874046:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 80 00000100:00100000:0.0:1788636745.874436:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11302:x1875521207057408:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636745.874466:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636745.874495:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39077 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.874706:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.874726:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.874749:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636745.874763:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788636745.874923:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.874932:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.874939:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.874947:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636745.874953:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.874962:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.874976:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:0.0:1788636745.874980:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636745.874986:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.874994:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8387fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.875050:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387f7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39077 expref: 26 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.875073:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:0.0:1788636745.875076:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636745.875080:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8387f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39077 expref: 26 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.875103:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7600, rc 0) 00000100:00100000:0.0:1788636745.875213:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11302:x1875521207057408:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 1156us (1988us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1788636745.875222:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 80 00000100:00100000:0.0:1788636745.879981:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636745.880699:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207057536 00000100:00100000:1.0:1788636745.880714:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207057536 00000100:00100000:1.0:1788636745.880783:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 81 00000100:00100000:1.0:1788636745.880792:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11302:x1875521207057536:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788636745.880859:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788636745.881003:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11302:x1875521207057536:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 210us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636745.881011:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 81 00000100:00100000:3.0:1788636745.893099:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636745.896489:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207057792 00000100:00100000:0.0:1788636745.896506:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207057792 00000100:00100000:0.0:1788636745.896580:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 82 00000100:00100000:0.0:1788636745.896591:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11302:x1875521207057792:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636745.896614:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636745.896617:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788636745.896651:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e8387b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39069 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.896672:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636745.896678:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636745.896706:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e83880c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3907e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788636745.897406:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788636745.897626:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838813 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.897642:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.897653:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838813 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.897727:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e83880c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3907e expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.897746:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838813 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3907e expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.897754:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef021c6700) 00010000:00010000:0.0:1788636745.897756:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636745.897759:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7a00, rc 0) 00000100:00100000:0.0:1788636745.897866:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:11302:x1875521207057792:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 1275us (4784us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788636745.897875:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 82 00000100:00100000:0.0:1788636745.906062:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.906339:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207058048 00000100:00100000:3.0:1788636745.906357:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207058048 00000100:00100000:3.0:1788636745.906448:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 83 00000100:00100000:3.0:1788636745.906471:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:11302:x1875521207058048:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636745.906558:0:13298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636745.907559:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838813 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3907e expref: 26 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.907669:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef021c6700) 00010000:00010000:3.0:1788636745.907686:0:13298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636745.908048:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838821 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908102:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838821 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908123:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838821 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908207:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838828 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa777d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908215:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838828 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa777d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908222:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838828 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa777d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908308:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838821 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908317:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838821 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908334:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838821 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908341:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636745.908347:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838821 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908354:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838821 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908368:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636745.908372:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636745.908377:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838821 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908385:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838821 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908403:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838828 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa777d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908409:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838828 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa777d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908416:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838828 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa777d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908439:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636745.908725:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838828 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa777d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908736:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838828 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa777d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908745:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa777d69 (ffff9cef021c6f00) 00010000:00010000:0.0:1788636745.908747:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636745.908750:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838828 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa777d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.908756:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838828 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa777d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636745.908935:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11302:x1875521207058048:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 2462us (2883us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636745.908949:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 83 00000100:00100000:0.0:1788636745.929374:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.929706:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207058176 00000100:00100000:3.0:1788636745.929721:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207058176 00000100:00100000:3.0:1788636745.929835:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 84 00000100:00100000:3.0:1788636745.929849:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11302:x1875521207058176:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636745.929878:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636745.929912:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e83882f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39085 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.929963:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.929981:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.930007:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.930182:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e83882f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39085 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.930221:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39085 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636745.930232:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:3.0:1788636745.930236:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636745.930240:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9e00, rc 0) 00000100:00100000:3.0:1788636745.930337:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:11302:x1875521207058176:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 480us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636745.930345:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 84 00000100:00100000:3.0:1788636745.937239:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636745.937609:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207058432 00000100:00100000:1.0:1788636745.937630:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207058432 00000100:00100000:1.0:1788636745.937716:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 85 00000100:00100000:1.0:1788636745.937729:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:11302:x1875521207058432:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788636745.937874:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.937898:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.937925:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636745.938188:0:11089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788636745.938203:0:11089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414749395030ns, next at 415749388967ns, rc = 0 00000004:00010000:1.0:1788636745.938283:0:11089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4d276fb reply state 0000000025a38b22 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.938301:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.938310:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:1.0:1788636745.938313:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788636745.938319:0:11089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636745.939289:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+28:11302:x1875521207058432:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 1551us (2057us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788636745.939301:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 85 00000100:00100000:0.0:1788636745.954447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636745.954713:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207058560 00000100:00100000:1.0:1788636745.954731:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207058560 00000100:00100000:1.0:1788636745.954856:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 86 00000100:00100000:1.0:1788636745.954869:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+28:11302:x1875521207058560:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636745.954907:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636745.954955:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e838844 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3908c expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.955051:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e838844 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3908c expref: 29 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.955095:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e838844 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3908c expref: 29 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636745.955121:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:1.0:1788636745.955125:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636745.955130:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37600, rc 0) 00000100:00100000:1.0:1788636745.955236:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:11302:x1875521207058560:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 369us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636745.955631:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 86 00000100:00100000:0.0:1788636745.960415:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.963861:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207058688 00000100:00100000:3.0:1788636745.963885:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207058688 00000100:00100000:3.0:1788636745.963957:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:3.0:1788636745.963969:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875521207058688:12345-192.168.202.26@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788636745.964021:0:9845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:3.0:1788636745.964066:0:9845:0:(genops.c:1385:class_connect()) connect: client a3091a46-1ad5-4415-b7a7-5e4bfab40689, cookie 0x5b741ef42e83884b 00002000:00100000:3.0:1788636745.964083:0:9845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a3091a46-1ad5-4415-b7a7-5e4bfab40689/ffff9cef03752000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788636745.964108:0:9845:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788636745.964220:0:9845:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788636745.964267:0:9845:0:(import.c:65:import_set_state_nolock()) ffff9cef03753000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636745.964374:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2397:x1875521207058688:12345-192.168.202.26@tcp:8:lhsmtool_posix.0 Request processed in 406us (3978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636745.964382:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:3.0:1788636745.968301:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636745.968396:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207058816 00000100:00100000:1.0:1788636745.968411:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207058816 00000100:00100000:1.0:1788636745.968523:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 34 00000100:00100000:1.0:1788636745.968537:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:0:x1875521207058816:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788636745.969043:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788636745.976375:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1788636745.976395:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000100:00100000:1.0:1788636745.976644:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:0:x1875521207058816:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 Request processed in 8102us (8354us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788636745.976658:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 34 00000100:00100000:0.0:1788636745.982688:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.982800:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207059072 00000100:00100000:3.0:1788636745.982900:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207059072 00000100:00100000:3.0:1788636745.983922:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:3.0:1788636745.983944:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:11302:x1875521207059072:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788636745.986765:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11302:x1875521207059072:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 2190us (3456us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788636745.986786:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:3.0:1788636745.991414:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636745.991478:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207059328 00000100:00100000:3.0:1788636745.991493:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207059328 00000100:00100000:3.0:1788636745.991566:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 87 00000100:00100000:3.0:1788636745.991579:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11302:x1875521207059328:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788636745.991739:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11302:x1875521207059328:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 161us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636745.991748:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 87 00000100:00100000:2.0:1788636745.996258:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636745.996509:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207059456 00000100:00100000:0.0:1788636745.996526:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207059456 00000100:00100000:0.0:1788636745.996616:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 88 00000100:00100000:0.0:1788636745.996627:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11302:x1875521207059456:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636745.996655:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636745.996682:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838852 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39093 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.996794:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838859 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.996872:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.996888:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636745.996948:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636745.996972:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838859 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.997006:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838852 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39093 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.997025:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838859 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39093 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636745.997036:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:0.0:1788636745.997039:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788636745.997044:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6000, rc 0) 00000100:00100000:0.0:1788636745.997138:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+31:11302:x1875521207059456:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 512us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636745.997146:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 88 00000100:00100000:1.0:1788636746.010084:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636746.010272:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207059584 00000100:00100000:3.0:1788636746.010286:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207059584 00000100:00100000:3.0:1788636746.010368:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 35 00000100:00100000:3.0:1788636746.010381:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207059584:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636746.010405:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636746.010432:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b8d715/0x5b741ef42e838860 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3909a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788636746.010468:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c6e4a, blocks: 0x0 00010000:00010000:3.0:1788636746.010493:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1788636746.010510:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636746.010521:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b8d715/0x5b741ef42e838860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3909a expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.010545:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029b8d715/0x5b741ef42e838860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3909a expref: 6 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.010563:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8000, rc 0) 00000100:00100000:3.0:1788636746.010632:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207059584:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 253us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636746.010639:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 35 00000100:00100000:0.0:1788636746.023419:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636746.024975:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207059840 00000100:00100000:2.0:1788636746.024995:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207059840 00000100:00100000:2.0:1788636746.025092:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 89 00000100:00100000:2.0:1788636746.025106:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+31:11302:x1875521207059840:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788636746.026944:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+31:11302:x1875521207059840:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 1830us (3530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636746.026961:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 89 00000100:00100000:2.0:1788636746.040482:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636746.040618:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207059968 00000100:00100000:3.0:1788636746.040633:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207059968 00000100:00100000:3.0:1788636746.040718:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 36 00000100:00100000:3.0:1788636746.040733:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:11302:x1875521207059968:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636746.040758:0:9845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636746.040786:0:9845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390a1 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.041023:0:9845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029b8d715/0x5b741ef42e838860 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3909a expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.041035:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636746.041042:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636746.041050:0:9845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.041205:0:9845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029b8d715/0x5b741ef42e838860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3909a expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.041227:0:9845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029b8d715/0x5b741ef42e838860 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3909a expref: 7 pid: 8437 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636746.041249:0:9845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9845:1875521226025088:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636746.041966:0:9845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033900 going to sleep for 11 seconds 00000100:00100000:3.0:1788636746.047596:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636746.048514:0:9845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9845:1875521226025088:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636746.048570:0:9845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.048600:0:9845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9200, rc 0) 00000100:00100000:1.0:1788636746.048693:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:11302:x1875521207059968:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 7963us (8231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636746.048719:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 36 00000100:00100000:1.0:1788636746.050923:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207060096 00000100:00100000:1.0:1788636746.050946:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207060096 00010000:00010000:1.0:1788636746.051027:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029b8d715/0x5b741ef42e838860 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3909a expref: 7 pid: 8437 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636746.051090:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:1.0:1788636746.051105:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207060096:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636746.051130:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636746.051598:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029b8d715/0x5b741ef42e838860 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3909a expref: 7 pid: 8437 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.051620:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029b8d715/0x5b741ef42e838860 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3909a expref: 7 pid: 8437 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.051657:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b8d715/0x5b741ef42e838860 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3909a expref: 7 pid: 8437 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.051685:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636746.051692:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636746.051702:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 6 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.051713:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 6 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.051793:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 6 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636746.053584:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1875521226025216:192.168.202.26@tcp:105: 00000100:00100000:1.0:1788636746.053760:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636746.067607:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1875521226025216:192.168.202.26@tcp:105: 00010000:00010000:1.0:1788636746.067644:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636746.067735:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207060096:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 16632us (20154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636746.067750:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:3.0:1788636746.069203:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636746.069369:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207060224 00000100:00100000:0.0:1788636746.069384:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207060224 00002000:00100000:0.0:1788636746.069486:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9cef035f1880 x1875521207060224/t0(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:232/0 lens 504/0 e 0 to 0 dl 1788636757 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636746.069500:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef035f1880 with x1875521207060224 ext(0->8) 00002000:00010000:0.0:1788636746.069508:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef035f1880 00000100:00100000:0.0:1788636746.069555:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 0 00000100:00100000:0.0:1788636746.069569:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207060224:12345-192.168.202.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788636746.076729:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207060224:12345-192.168.202.26@tcp:4:lhsmtool_posix.0 Request processed in 7147us (7524us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788636746.076956:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 0 00002000:00100000:0.0:1788636746.076971:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9cef035f1880 x1875521207060224/t4294967303(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:232/0 lens 504/448 e 0 to 0 dl 1788636757 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636746.076980:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef035f1880 with x1875521207060224 ext(0->8) 00002000:00010000:0.0:1788636746.076986:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef035f1880 00000100:00100000:3.0:1788636746.086638:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636746.086780:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207060352 00000100:00100000:1.0:1788636746.086794:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207060352 00000100:00100000:1.0:1788636746.087050:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 90 00000100:00100000:1.0:1788636746.087064:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+31:11302:x1875521207060352:12345-192.168.202.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788636746.099024:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1788636746.099042:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788636746.099085:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:3.0:1788636746.099352:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099372:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099382:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099389:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636746.099395:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099405:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099433:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:3.0:1788636746.099453:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636746.099460:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099468:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83873a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099494:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099501:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099507:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099513:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636746.099516:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099522:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099532:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:3.0:1788636746.099534:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788636746.099537:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.099542:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e83883d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788636746.101120:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788636746.101141:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:1.0:1788636746.101163:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788636746.101175:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226025344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788636746.101254:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636746.113702:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:11302:x1875521207060352:12345-192.168.202.26@tcp:44:lhsmtool_posix.0 Request processed in 26620us (27058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636746.113735:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 90 00000100:00100000:1.0:1788636746.113862:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226025344 00000100:00100000:1.0:1788636746.113882:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226025344 00000100:00100000:1.0:1788636746.113982:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788636746.113996:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226025344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788636746.114656:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788636746.114675:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788636746 00002000:00010000:1.0:1788636746.114679:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788636746.114693:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788636746 -> 1788636746 00002000:00010000:1.0:1788636746.114696:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788636746.114877:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226025344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 882us (13620us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788636746.115308:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788636746.115357:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788636746.117355:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cef03657b80/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788636746.117380:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226025344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788636746.118681:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636746.119129:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207060480 00000100:00100000:1.0:1788636746.119202:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207060480 00000100:00100000:1.0:1788636746.119291:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 38 00000100:00100000:1.0:1788636746.119302:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2400:x1875521207060480:12345-192.168.202.26@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788636746.124193:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788636746.124223:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1788636746.124414:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207060480:12345-192.168.202.26@tcp:16:lhsmtool_posix.0 Request processed in 5101us (5733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636746.124488:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 38 00000100:00100000:3.0:1788636746.127428:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636746.127618:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207060736 00000100:00100000:2.0:1788636746.127633:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207060736 00000100:00100000:2.0:1788636746.127701:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 91 00000100:00100000:2.0:1788636746.127711:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:11302:x1875521207060736:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788636746.127780:0:13298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636746.127835:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838859 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39093 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.127856:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:2.0:1788636746.127862:0:13298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636746.127895:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.127925:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.127936:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636746.128092:0:13298:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000003f51ba reply state 000000003d313881 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.128105:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.128112:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:2.0:1788636746.128114:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636746.128117:0:13298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636746.128254:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:11302:x1875521207060736:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 542us (836us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788636746.128263:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 91 00000100:00100000:3.0:1788636746.134270:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636746.134903:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207060864 00000100:00100000:1.0:1788636746.134920:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207060864 00000100:00100000:1.0:1788636746.134994:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 39 00000100:00100000:1.0:1788636746.135006:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207060864:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788636746.135519:0:9845:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788636746.135525:0:9845:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788636746 -> 1788636745 00002000:00010000:1.0:1788636746.135528:0:9845:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788636743 00002000:00010000:1.0:1788636746.135529:0:9845:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788636746 -> 1788636745 00002000:00010000:1.0:1788636746.135532:0:9845:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788636746.135626:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207060864:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 Request processed in 620us (1374us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788636746.135637:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 39 00010000:00010000:1.0:1788636746.135749:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636746.141289:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636746.141422:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207061120 00000100:00100000:3.0:1788636746.141537:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207061120 00000100:00100000:3.0:1788636746.141647:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 92 00000100:00100000:3.0:1788636746.141665:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:11302:x1875521207061120:12345-192.168.202.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788636746.141783:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.142376:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39085 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.142394:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.142528:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39085 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.142552:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39085 expref: 15 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636746.142571:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226025472:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636746.147668:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636746.148062:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636746.148204:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207061248 00000100:00100000:0.0:1788636746.148216:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207061248 00010000:00010000:0.0:1788636746.148281:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39085 expref: 16 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636746.148341:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:0.0:1788636746.148352:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:2400:x1875521207061248:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636746.148371:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636746.148380:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39085 expref: 16 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636746.148416:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39085 expref: 16 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636746.148458:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:0.0:1788636746.148466:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636746.148478:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636746.148488:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636746.148514:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636746.148592:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:2400:x1875521207061248:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 240us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636746.148601:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 60 00010000:00010000:3.0:1788636746.152398:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e838836 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39085 expref: 15 pid: 6521 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636746.152928:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226025472:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636746.152992:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.153003:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.153009:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.153503:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.153518:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.153528:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.153535:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636746.153542:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.153551:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.153574:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:3.0:1788636746.153578:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788636746.153585:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.153592:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838875 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636746.154003:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:11302:x1875521207061120:12345-192.168.202.26@tcp:55:lhsmtool_posix.0 Request processed in 12339us (12723us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788636746.154015:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 92 00000100:00100000:2.0:1788636746.161417:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636746.163082:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207061376 00000100:00100000:1.0:1788636746.163104:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207061376 00000100:00100000:1.0:1788636746.163204:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 40 00000100:00100000:1.0:1788636746.163219:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207061376:12345-192.168.202.26@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788636746.163279:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.163306:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.163318:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636746.163334:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636746.163341:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.164371:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.164395:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 7 pid: 9845 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636746.164413:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1875521226025600:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636746.164851:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636746.174634:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636746.174764:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1875521226025600:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636746.175120:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636746.179198:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207061504 00000100:00100000:2.0:1788636746.179221:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207061504 00010000:00010000:2.0:1788636746.179282:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 8 pid: 9845 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636746.179343:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:2.0:1788636746.179355:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207061504:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636746.179375:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636746.179418:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 8 pid: 9845 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.180950:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 8 pid: 9845 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.180990:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b8c5740/0x5b741ef42e838867 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a1 expref: 8 pid: 9845 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.181012:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636746.181019:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636746.181028:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.181042:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.181532:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636746.181546:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.181565:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.181594:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.181603:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.181612:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.181619:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36800 already unused, calling callback (ffffffffc0d844f0) 00000100:00100000:2.0:1788636746.181626:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207061504:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 2266us (6997us total) trans 0 rc 0/0 00010000:00010000:1.0:1788636746.181627:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.181654:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636746.181659:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 61 00010000:00010000:1.0:1788636746.181684:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.181711:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f58e7acb/0x5b741ef42e83887c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636746.181798:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207061376:12345-192.168.202.26@tcp:1:lhsmtool_posix.0 Request processed in 18578us (20397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636746.181842:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 40 00000100:00100000:1.0:1788636746.186470:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636746.186521:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207061760 00000100:00100000:1.0:1788636746.186532:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207061760 00000100:00100000:1.0:1788636746.186606:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 93 00000100:00100000:1.0:1788636746.186618:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:11302:x1875521207061760:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788636746.186712:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.187942:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3902a expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.187959:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.188014:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3902a expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.188031:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3902a expref: 14 pid: 6522 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636746.188070:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226025728:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636746.188162:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636746.194623:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636746.195350:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207061888 00000100:00100000:3.0:1788636746.195370:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207061888 00010000:00010000:3.0:1788636746.195450:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3902a expref: 15 pid: 6522 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636746.195512:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:3.0:1788636746.195524:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:2401:x1875521207061888:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636746.195545:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636746.195553:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3902a expref: 15 pid: 6522 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.195571:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3902a expref: 15 pid: 6522 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.195603:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:3.0:1788636746.195611:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.195624:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.195634:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.195662:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636746.198816:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:2401:x1875521207061888:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 3263us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636746.198836:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 62 00010000:00010000:1.0:1788636746.200981:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8386c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3902a expref: 14 pid: 6522 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636746.201011:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226025728:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636746.201044:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.201055:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.201061:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.201339:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.201582:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e838844 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3908c expref: 14 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.201594:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.201644:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e838844 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3908c expref: 14 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.201684:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e838844 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3908c expref: 14 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636746.201699:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226025856:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636746.202066:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636746.205440:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636746.205491:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207062016 00000100:00100000:0.0:1788636746.205504:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207062016 00010000:00010000:0.0:1788636746.205562:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e838844 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3908c expref: 15 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636746.205612:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:0.0:1788636746.205626:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:2400:x1875521207062016:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636746.205648:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636746.205683:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e838844 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3908c expref: 15 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636746.205701:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e838844 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3908c expref: 15 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636746.205737:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:0.0:1788636746.205745:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636746.205761:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636746.205772:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636746.205801:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636746.205888:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:2400:x1875521207062016:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 265us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636746.205896:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 63 00010000:00010000:3.0:1788636746.207073:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e838844 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3908c expref: 14 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636746.207107:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226025856:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636746.207147:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.207159:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.207165:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636746.207850:0:11089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788636746.208012:0:11089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788636746.208054:0:11089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788636746.208161:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11089:1875521226025984:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788636746.208258:0:11089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636746.208987:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226025984 00000100:00100000:0.0:1788636746.208998:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226025984 00000100:00100000:0.0:1788636746.209155:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788636746.209170:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:11089:x1875521226025984:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788636746.209295:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:11089:x1875521226025984:12345-0@lo:1000:mdt00_003.0 Request processed in 128us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636746.209303:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788636746.209967:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033600 going to sleep for 11 seconds 00000100:00100000:2.0:1788636746.210022:0:11089:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788636746.210028:0:11089:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cef03657b80, transno 4294967304 00000100:00100000:2.0:1788636746.210468:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11089:1875521226025984:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788636746.210661:0:11089:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788636746.210764:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032407800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11089:1875521226026112:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788636746.210934:0:11089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636746.210972:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636746.211018:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226026112 00000100:00100000:3.0:1788636746.211030:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226026112 00000100:00100000:3.0:1788636746.211101:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788636746.211112:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11089:x1875521226026112:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788636746.211333:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11089:x1875521226026112:12345-0@lo:1000:mdt00_003.0 Request processed in 212us (391us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788636746.211342:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788636746.211424:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032407800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:11089:1875521226026112:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788636746.211471:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211482:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211490:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211496:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636746.211501:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211510:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211526:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:2.0:1788636746.211529:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636746.211534:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211540:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83888a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211569:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8387bf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211577:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8387bf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211592:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8387bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211598:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636746.211602:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8387bf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211609:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8387bf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211619:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636746.211621:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636746.211625:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8387bf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211631:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8387bf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211658:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211674:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39070 expref: 17 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211684:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211713:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39070 expref: 17 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.211753:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39070 expref: 17 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636746.211768:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226026240:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636746.212084:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636746.215467:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636746.215540:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207062144 00000100:00100000:2.0:1788636746.215546:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226026240:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636746.215567:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207062144 00010000:00010000:2.0:1788636746.215583:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.215627:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39070 expref: 18 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636746.215680:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:3.0:1788636746.215695:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2401:x1875521207062144:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636746.215717:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636746.215726:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39070 expref: 18 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.215742:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39070 expref: 18 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.215772:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8387db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39070 expref: 18 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.215791:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:3.0:1788636746.215797:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.215828:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.215838:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.215868:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636746.215921:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.215932:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636746.215946:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:2401:x1875521207062144:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 254us (487us total) trans 0 rc 0/0 00010000:00010000:2.0:1788636746.215950:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.215973:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636746.215981:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 64 00010000:00010000:2.0:1788636746.215993:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216001:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636746.216007:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216039:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216060:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636746.216063:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636746.216070:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216076:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838891 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216094:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216100:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216105:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216110:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636746.216113:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216119:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216126:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331c200) 00010000:00010000:2.0:1788636746.216129:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788636746.216132:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.216148:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838883 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636746.216389:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:11302:x1875521207061760:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 29770us (29932us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788636746.216399:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 93 00000020:00080000:2.0:1788636746.216406:0:11089:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788636746.216439:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636746.216448:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636746.216465:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788636746.216472:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788636746.225357:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636746.225451:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207062400 00000100:00100000:1.0:1788636746.225470:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207062400 00000100:00100000:1.0:1788636746.225552:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:1.0:1788636746.225566:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:11302:x1875521207062400:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788636746.225992:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788636746.226047:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1788636746.226112:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.226135:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.226157:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.226168:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.226176:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.226183:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636746.226224:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636746.226316:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636746.226340:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.226354:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636746.226359:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.226369:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636746.226395:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:11302:x1875521207062400:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 827us (1048us total) trans 4294967364 rc 0/0 00010000:00010000:2.0:1788636746.226396:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:2.0:1788636746.226417:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:1.0:1788636746.226425:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 20 00010000:00010000:2.0:1788636746.226427:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788636746.226434:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788636746.226437:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838898 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.226468:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636746.226470:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636746.226472:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636746.389268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226026368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636746.389414:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636746.389938:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226026368 00000100:00100000:3.0:1788636746.389953:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226026368 00000100:00100000:3.0:1788636746.390026:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788636746.390039:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226026368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636746.390105:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788636746.390181:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226026368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636746.390190:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788636746.390454:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226026368:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788636746.754416:0:14217:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636746.754447:0:14217:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636746.754507:0:14217:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788636746.754518:0:14217:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788636746.896664:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636746.896718:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636746.896757:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636746.896792:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636746.896834:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636746.896863:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636746.896899:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207062656 00000100:00100000:0.0:1788636746.896912:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207062656 00000100:00100000:0.0:1788636746.896984:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207063168 00000100:00100000:0.0:1788636746.896987:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207063168 00000100:00100000:0.0:1788636746.897008:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207063040 00000100:00100000:0.0:1788636746.897010:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207063040 00000100:00100000:0.0:1788636746.897032:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 322 00000100:00100000:0.0:1788636746.897043:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207062656:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636746.897143:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207062656:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 100us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636746.897151:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 322 00000100:00100000:0.0:1788636746.897168:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 323 00000100:00100000:0.0:1788636746.897175:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207063168:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636746.897199:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207063168:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636746.897205:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 323 00000100:00100000:0.0:1788636746.897217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 324 00000100:00100000:0.0:1788636746.897244:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207063040:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636746.897271:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207063040:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636746.897276:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 324 00000100:00100000:2.0:1788636746.897616:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207062912 00000100:00100000:2.0:1788636746.897633:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207062912 00000100:00100000:2.0:1788636746.897666:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207062784 00000100:00100000:2.0:1788636746.897669:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207062784 00000100:00100000:2.0:1788636746.897698:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 123 00000100:00100000:2.0:1788636746.897704:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207062912:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636746.897739:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207062912:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 35us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636746.897745:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 123 00000100:00100000:2.0:1788636746.897759:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 124 00000100:00100000:2.0:1788636746.897766:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207062784:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636746.897790:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207062784:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 25us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636746.897795:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 124 00000100:00100000:2.0:1788636746.897830:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207062528 00000100:00100000:2.0:1788636746.897833:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207062528 00000100:00100000:2.0:1788636746.897861:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 390 00000100:00100000:2.0:1788636746.897867:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207062528:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636746.897893:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207062528:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 26us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636746.897899:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 390 00000100:00080000:2.0:1788636746.899965:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636746.899983:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636746.899989:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636746.950797:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636746.950949:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207063424 00000100:00100000:3.0:1788636746.950959:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207063424 00000100:00100000:3.0:1788636746.951023:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 94 00000100:00100000:3.0:1788636746.951035:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:11314:x1875521207063424:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636746.951061:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636746.951089:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e83889f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390a8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.951208:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e8388a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.951223:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e8388a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.951235:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e8388a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636746.951253:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788636746.951378:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e83889f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a8 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.951398:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e8388a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a8 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636746.951408:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:3.0:1788636746.951411:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788636746.951415:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9e00, rc 0) 00000100:00100000:3.0:1788636746.951477:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:11314:x1875521207063424:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 445us (691us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788636746.951484:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 94 00000100:00100000:0.0:1788636746.953719:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636746.953832:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207063552 00000100:00100000:2.0:1788636746.953845:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207063552 00000100:00100000:2.0:1788636746.953911:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 95 00000100:00100000:2.0:1788636746.953923:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:11314:x1875521207063552:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:2.0:1788636746.954030:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e8388b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954050:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e8388b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954064:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e8388b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954082:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954090:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954096:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954184:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954192:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954198:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636746.954247:0:11089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954263:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e8388b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954282:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e8388b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954289:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e8388b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954294:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636746.954300:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e8388b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954307:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e8388b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954332:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636746.954336:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636746.954342:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e8388b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954349:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e8388b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954366:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954371:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954377:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954382:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636746.954393:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954399:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954407:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0336e500) 00010000:00010000:2.0:1788636746.954410:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636746.954413:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954418:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954433:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954438:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954443:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954448:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636746.954450:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954456:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954463:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0336e800) 00010000:00010000:2.0:1788636746.954465:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636746.954474:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636746.954480:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636746.954564:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:11314:x1875521207063552:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 643us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636746.954573:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 95 00000100:00100000:3.0:1788636747.050404:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.050450:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207063808 00000100:00100000:3.0:1788636747.050465:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207063808 00000100:00100000:3.0:1788636747.050541:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 96 00000100:00100000:3.0:1788636747.050553:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:11317:x1875521207063808:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636747.050575:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636747.050601:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390af expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.050684:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8388d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.050699:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8388d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.050733:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8388d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.050750:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8388d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.050757:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8388d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.050764:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8388d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.050941:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.050949:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.050956:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636747.052484:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788636747.052628:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8388d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052640:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8388d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052647:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8388d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052653:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636747.052666:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8388d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052674:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8388d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052691:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:3.0:1788636747.052694:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636747.052699:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8388d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052706:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8388d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052718:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8388d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052725:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8388d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052731:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8388d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052737:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636747.052740:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8388d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052746:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8388d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052754:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0331c000) 00010000:00010000:3.0:1788636747.052756:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636747.052765:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8388d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052771:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8388d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052858:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390af expref: 23 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052874:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390af expref: 22 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.052882:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:3.0:1788636747.052884:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636747.052887:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9800, rc 0) 00000100:00100000:3.0:1788636747.052960:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11317:x1875521207063808:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 2408us (2574us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788636747.057114:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 96 00000100:00080000:3.0:1788636747.057194:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636747.070547:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.075529:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207063936 00000100:00100000:3.0:1788636747.075547:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207063936 00000100:00100000:3.0:1788636747.075624:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 97 00000100:00100000:3.0:1788636747.075635:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11317:x1875521207063936:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:3.0:1788636747.075710:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.075728:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.075740:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.075792:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.075800:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.075844:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.075852:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636747.075857:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.075865:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.075877:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:3.0:1788636747.075881:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636747.075886:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.075893:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8388ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636747.076112:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11317:x1875521207063936:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 477us (5570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636747.076121:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 97 00000100:00100000:3.0:1788636747.081578:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.083093:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207064192 00000100:00100000:2.0:1788636747.083108:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207064192 00000100:00100000:2.0:1788636747.083170:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:2.0:1788636747.083182:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11317:x1875521207064192:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:2.0:1788636747.083508:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:11317:x1875521207064192:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 326us (1938us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788636747.083516:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:0.0:1788636747.120387:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.120503:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207064448 00000100:00100000:2.0:1788636747.120513:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207064448 00000100:00100000:2.0:1788636747.120577:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 98 00000100:00100000:2.0:1788636747.120587:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:10843:x1875521207064448:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636747.120615:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636747.120637:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390b6 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.120767:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.120782:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390af expref: 24 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.120855:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.120890:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390af expref: 24 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.120903:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390af expref: 24 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636747.120916:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226026496:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636747.121004:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788636747.124369:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226026496:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636747.124412:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636747.124852:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.125052:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207064576 00000100:00100000:3.0:1788636747.125060:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207064576 00010000:00010000:3.0:1788636747.125115:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390af expref: 25 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636747.125161:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 65 00000100:00100000:3.0:1788636747.125172:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:2401:x1875521207064576:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636747.125185:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636747.125193:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390af expref: 25 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.125206:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390af expref: 25 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.125229:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8388de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390af expref: 25 pid: 13298 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.125250:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:3.0:1788636747.125256:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.125267:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.125274:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.125308:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636747.125400:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:2401:x1875521207064576:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 229us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636747.125407:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 65 00010000:00010000:2.0:1788636747.125611:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.125619:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636747.125639:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788636747.125793:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e8388f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390b6 expref: 25 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.125853:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390b6 expref: 24 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.125861:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:2.0:1788636747.125863:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636747.125866:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1000, rc 0) 00000100:00100000:2.0:1788636747.125915:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:10843:x1875521207064448:12345-192.168.202.26@tcp:101:bash.0 Request processed in 5330us (5541us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788636747.125923:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 98 00000100:00100000:0.0:1788636747.133102:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.133529:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207064704 00000100:00100000:3.0:1788636747.133545:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207064704 00000100:00100000:3.0:1788636747.133710:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 99 00000100:00100000:3.0:1788636747.133723:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:10843:x1875521207064704:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636747.133763:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636747.133797:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838908 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390bd expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.133988:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83890f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.134009:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83890f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.134026:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83890f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.134243:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838908 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390bd expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.134268:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83890f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390bd expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.134280:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:3.0:1788636747.134283:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636747.134288:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9c00, rc 0) 00000100:00100000:3.0:1788636747.134436:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:10843:x1875521207064704:12345-192.168.202.26@tcp:101:bash.0 Request processed in 714us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636747.134444:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 99 00000100:00100000:2.0:1788636747.138390:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.138558:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207064960 00000100:00100000:3.0:1788636747.138652:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207064960 00000100:00100000:3.0:1788636747.138743:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 100 00000100:00100000:3.0:1788636747.138755:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:10843:x1875521207064960:12345-192.168.202.26@tcp:36:bash.0 00010000:00010000:3.0:1788636747.139336:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.139361:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.139525:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636747.139637:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788636747.139669:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c5eea3d reply state 00000000e64f828f transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.139685:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.139693:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:3.0:1788636747.139697:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788636747.139702:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788636747.140405:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788636747.140626:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:10843:x1875521207064960:12345-192.168.202.26@tcp:36:bash.0 Request processed in 1866us (2240us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788636747.140638:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 100 00000020:00080000:2.0:1788636747.140644:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788636747.145514:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.145694:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207065088 00000100:00100000:2.0:1788636747.145710:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207065088 00000100:00100000:2.0:1788636747.145794:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 101 00000100:00100000:2.0:1788636747.146097:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:10843:x1875521207065088:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636747.146133:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636747.146162:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e83891d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390c4 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.146243:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e83891d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390c4 expref: 30 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.146262:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e83891d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390c4 expref: 30 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.146285:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:2.0:1788636747.146289:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636747.146295:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0a00, rc 0) 00000100:00100000:2.0:1788636747.146380:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:10843:x1875521207065088:12345-192.168.202.26@tcp:101:bash.0 Request processed in 574us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636747.146409:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 101 00000100:00100000:0.0:1788636747.150878:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636747.152601:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207065216 00000100:00100000:1.0:1788636747.152623:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207065216 00000100:00100000:1.0:1788636747.152757:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 41 00000100:00100000:1.0:1788636747.152773:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:10843:x1875521207065216:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:1.0:1788636747.153230:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636747.153273:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcad6001/0x5b741ef42e838924 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390cb expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636747.153330:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c6e49, atime: 0x6a9c6e47, ctime: 0x6a9c6e49, blocks: 0x8 00010000:00010000:1.0:1788636747.153365:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1788636747.153371:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636747.153383:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcad6001/0x5b741ef42e838924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390cb expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.153406:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bcad6001/0x5b741ef42e838924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390cb expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.153456:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37600, rc 0) 00000100:00080000:3.0:1788636747.153763:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636747.154402:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:10843:x1875521207065216:12345-192.168.202.26@tcp:101:bash.0 Request processed in 1625us (3591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636747.154415:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 41 00010000:00010000:1.0:1788636747.157089:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636747.162627:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636747.163272:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207065344 00000100:00100000:1.0:1788636747.163288:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207065344 00002000:00010000:1.0:1788636747.163361:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788636747.163367:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef040f0700 with x1875521207065344 ext(0->18446744073709551615) 00002000:00010000:1.0:1788636747.163384:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef040f0700. 00000100:00100000:1.0:1788636747.163536:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 1 00000100:00100000:1.0:1788636747.163549:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2399:x1875521207065344:12345-192.168.202.26@tcp:10:bash.0 00002000:00010000:1.0:1788636747.164126:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788636747.164131:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788636745 -> 1788636747 00002000:00010000:1.0:1788636747.164135:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788636743 -> 1788636743 00002000:00010000:1.0:1788636747.164137:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788636745 -> 1788636747 00002000:00010000:1.0:1788636747.164139:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788636747.164233:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2399:x1875521207065344:12345-192.168.202.26@tcp:10:bash.0 Request processed in 685us (1620us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788636747.164244:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 1 00002000:00010000:1.0:1788636747.164249:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788636747.164252:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef040f0700 with x1875521207065344 ext(0->18446744073709551615) 00002000:00010000:1.0:1788636747.164258:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef040f0700. 00000100:00100000:3.0:1788636747.295260:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636747.295382:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207065472 00000100:00100000:0.0:1788636747.295399:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207065472 00000100:00100000:0.0:1788636747.295484:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 102 00000100:00100000:0.0:1788636747.295500:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11331:x1875521207065472:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:0.0:1788636747.295620:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e83892b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.295775:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e83892b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.295796:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e83892b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.295943:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838932 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.295952:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.295959:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296072:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296083:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296091:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788636747.296155:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296170:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e83892b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296177:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e83892b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296185:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e83892b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296191:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636747.296196:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e83892b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296213:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e83892b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296228:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636747.296232:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636747.296237:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e83892b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296244:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e83892b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296260:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838932 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296267:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838932 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296274:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296278:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636747.296281:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838932 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296287:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838932 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296294:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef021c6f00) 00010000:00010000:0.0:1788636747.296297:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636747.296299:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838932 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296316:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838932 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296362:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296369:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296374:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296379:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636747.296382:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296388:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296396:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:0.0:1788636747.296398:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636747.296401:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.296407:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636747.296523:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11331:x1875521207065472:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 1024us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636747.296532:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 102 00000100:00100000:0.0:1788636747.367211:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.367337:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207065728 00000100:00100000:2.0:1788636747.367357:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207065728 00000100:00100000:2.0:1788636747.367442:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 103 00000100:00100000:2.0:1788636747.367454:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11334:x1875521207065728:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636747.367489:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636747.367518:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838940 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390d2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.367623:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838947 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.367643:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.367658:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.367677:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83894e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.367684:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83894e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.367692:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83894e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.367906:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838955 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.367936:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.367944:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838955 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636747.367957:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788636747.368072:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838947 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368081:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838947 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368088:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838947 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368095:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636747.368100:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838947 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368110:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838947 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368124:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636747.368127:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636747.368133:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838947 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368140:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838947 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368158:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83894e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368172:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83894e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368178:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83894e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368183:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636747.368186:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83894e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368193:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83894e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368201:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0336e600) 00010000:00010000:2.0:1788636747.368204:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636747.368206:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83894e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368213:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e83894e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368264:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838940 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390d2 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368280:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838955 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390d2 expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.368288:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:2.0:1788636747.368291:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788636747.368301:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0600, rc 0) 00000100:00100000:2.0:1788636747.368456:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:11334:x1875521207065728:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1003us (1260us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788636747.368466:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 103 00000100:00100000:1.0:1788636747.378439:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.378756:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207065856 00000100:00100000:2.0:1788636747.378772:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207065856 00000100:00100000:2.0:1788636747.378894:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 104 00000100:00100000:2.0:1788636747.378908:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:11334:x1875521207065856:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:2.0:1788636747.379024:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.379046:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390b6 expref: 32 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.379059:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.379116:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390b6 expref: 32 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.379136:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390b6 expref: 32 pid: 11089 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636747.379155:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226026624:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636747.379301:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788636747.387145:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.387259:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207066112 00000100:00100000:3.0:1788636747.387277:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207066112 00000100:00100000:3.0:1788636747.387390:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:3.0:1788636747.387408:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+33:6172:x1875521207066112:12345-192.168.202.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788636747.388264:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226026624:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636747.388272:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+34:6172:x1875521207066112:12345-192.168.202.26@tcp:35:ldlm_bl.0 Request processed in 866us (1139us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788636747.388304:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 22 00010000:00010000:2.0:1788636747.388306:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636747.397695:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.401624:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207066240 00000100:00100000:2.0:1788636747.401651:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207066240 00010000:00010000:2.0:1788636747.401732:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390b6 expref: 34 pid: 11089 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636747.401851:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 66 00000100:00100000:2.0:1788636747.401868:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+34:2400:x1875521207066240:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636747.401893:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636747.401902:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390b6 expref: 34 pid: 11089 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.401918:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390b6 expref: 34 pid: 11089 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.401949:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8388fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390b6 expref: 34 pid: 11089 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.401974:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:2.0:1788636747.401980:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.402006:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.402016:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.402059:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636747.402164:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636747.402169:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+33:2400:x1875521207066240:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 303us (4491us total) trans 0 rc 0/0 00010000:00010000:0.0:1788636747.402182:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636747.402187:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 66 00010000:00010000:0.0:1788636747.402248:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.402257:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.402264:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.402270:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636747.402276:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.402286:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.402297:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:0.0:1788636747.402300:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636747.402304:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.402311:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838963 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636747.402378:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:11334:x1875521207065856:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 23473us (23975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636747.402400:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 104 00000100:00100000:0.0:1788636747.406578:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.406688:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207066496 00000100:00100000:3.0:1788636747.406704:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207066496 00000100:00100000:3.0:1788636747.406792:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:3.0:1788636747.407021:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:11334:x1875521207066496:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636747.407351:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+33:11334:x1875521207066496:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 548us (792us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788636747.407361:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:1.0:1788636747.518180:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.518349:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207066752 00000100:00100000:2.0:1788636747.518367:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207066752 00000100:00100000:2.0:1788636747.518482:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 105 00000100:00100000:2.0:1788636747.518514:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+33:11345:x1875521207066752:12345-192.168.202.26@tcp:101:cat.0 00010000:00010000:2.0:1788636747.518553:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636747.518586:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83896a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390d9 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.518699:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838971 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.518719:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838971 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.518737:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838971 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.518757:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838978 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.518765:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.518772:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.518988:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e83897f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519029:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e83897f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519036:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e83897f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636747.519050:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788636747.519187:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838971 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519196:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838971 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519203:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838971 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519210:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636747.519215:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838971 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519224:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838971 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519245:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636747.519248:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636747.519254:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838971 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519263:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838971 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519285:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519299:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838978 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519306:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838978 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519311:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636747.519315:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838978 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519345:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838978 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519355:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0336e600) 00010000:00010000:2.0:1788636747.519358:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636747.519361:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838978 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519368:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838978 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519439:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83896a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390d9 expref: 36 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519455:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e83897f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390d9 expref: 35 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.519461:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:2.0:1788636747.519464:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636747.519474:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1a00, rc 0) 00000100:00100000:2.0:1788636747.519655:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+35:11345:x1875521207066752:12345-192.168.202.26@tcp:101:cat.0 Request processed in 1144us (1492us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788636747.519666:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 105 00000100:00100000:0.0:1788636747.528203:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636747.528362:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207067008 00000100:00100000:1.0:1788636747.528378:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207067008 00000100:00100000:1.0:1788636747.528479:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:1.0:1788636747.528495:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+35:11345:x1875521207067008:12345-192.168.202.26@tcp:35:cat.0 00000100:00100000:1.0:1788636747.529031:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:11345:x1875521207067008:12345-192.168.202.26@tcp:35:cat.0 Request processed in 537us (841us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788636747.529041:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:0.0:1788636747.553620:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.553981:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207067264 00000100:00100000:2.0:1788636747.554007:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207067264 00000100:00100000:2.0:1788636747.554084:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 106 00000100:00100000:2.0:1788636747.554100:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:11346:x1875521207067264:12345-192.168.202.26@tcp:36:rm.0 00010000:00010000:2.0:1788636747.554198:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788636747.554241:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e83891d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390c4 expref: 36 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554271:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e83897f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390d9 expref: 35 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554286:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838955 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390d2 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554300:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83890f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390bd expref: 33 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554315:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:2.0:1788636747.554335:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636747.554372:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83898d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554391:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83898d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554431:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83898d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554450:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554459:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554465:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554598:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83899b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554608:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83899b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.554615:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83899b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788636747.555007:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788636747.555020:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416366212838ns, next at 417366209182ns, rc = 0 00010000:00010000:2.0:1788636747.555085:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555095:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555103:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555127:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555135:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555143:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555181:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636747.555207:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83899b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555214:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83899b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555221:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83899b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555227:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636747.555234:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83899b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555243:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83899b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555254:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:2.0:1788636747.555257:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788636747.555263:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83899b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555282:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e83899b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555306:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83898d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555312:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83898d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555331:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83898d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555336:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636747.555340:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83898d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555346:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83898d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555355:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636747.555357:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636747.555361:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83898d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555367:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e83898d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636747.555379:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be5acfe4 reply state 00000000d3c5b5c8 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555391:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.555407:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0336e600) 00010000:00010000:2.0:1788636747.555409:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636747.555412:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636747.555515:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+34:11346:x1875521207067264:12345-192.168.202.26@tcp:36:rm.0 Request processed in 1415us (1910us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788636747.555525:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 106 00010000:00010000:3.0:1788636747.556096:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636747.556107:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.556116:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636747.556120:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.556129:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.556141:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:3.0:1788636747.556144:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788636747.556154:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.556162:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e8389a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.556175:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636747.556187:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636747.556189:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636747.608506:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636747.610785:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207067520 00000100:00100000:0.0:1788636747.610844:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207067520 00000100:00100000:0.0:1788636747.610949:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 107 00000100:00100000:0.0:1788636747.610963:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+34:11352:x1875521207067520:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:0.0:1788636747.611004:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636747.611034:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e8389a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390e0 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.611182:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8389b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.611204:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8389b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.611219:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8389b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.611233:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.611241:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.611248:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788636747.611745:0:11089:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788636747.611966:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.611978:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.611986:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612030:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8389b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612038:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8389b0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612046:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8389b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612053:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636747.612059:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8389b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612068:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8389b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612084:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636747.612087:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636747.612093:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8389b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612113:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e8389b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788636747.612129:0:11089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000258c1554 reply state 000000001f2a255d transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612142:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612148:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0336e600) 00010000:00010000:0.0:1788636747.612151:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788636747.612154:0:11089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788636747.612192:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e8389a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e0 expref: 37 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612208:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e0 expref: 36 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.612216:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef021c6f00) 00010000:00010000:0.0:1788636747.612218:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636747.612221:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7600, rc 0) 00000100:00100000:0.0:1788636747.612329:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:11352:x1875521207067520:12345-192.168.202.26@tcp:101:bash.0 Request processed in 1359us (3832us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788636747.612339:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 107 00000100:00100000:0.0:1788636747.620381:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.620558:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207067648 00000100:00100000:2.0:1788636747.620576:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207067648 00000100:00100000:2.0:1788636747.620690:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 42 00000100:00100000:2.0:1788636747.620704:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207067648:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636747.620729:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636747.620756:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce76106f/0x5b741ef42e8389cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390e7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636747.620791:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788636747.620849:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1788636747.620855:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636747.620867:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce76106f/0x5b741ef42e8389cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e7 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.620892:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce76106f/0x5b741ef42e8389cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e7 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.620912:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1c00, rc 0) 00000100:00100000:2.0:1788636747.620996:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207067648:12345-192.168.202.26@tcp:101:bash.0 Request processed in 294us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636747.621023:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 42 00000100:00100000:1.0:1788636747.623669:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636747.624970:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207067776 00000100:00100000:0.0:1788636747.624986:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207067776 00000100:00100000:0.0:1788636747.625053:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 43 00000100:00100000:0.0:1788636747.625096:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:11352:x1875521207067776:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:0.0:1788636747.625120:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636747.625142:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390ee expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.625181:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce76106f/0x5b741ef42e8389cc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e7 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.625191:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636747.625197:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636747.625203:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.625248:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce76106f/0x5b741ef42e8389cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e7 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.625265:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce76106f/0x5b741ef42e8389cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e7 expref: 9 pid: 8438 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636747.625283:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1875521226026752:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636747.625428:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548840 going to sleep for 11 seconds 00000100:00100000:1.0:1788636747.628748:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636747.628803:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1875521226026752:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636747.628886:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.628959:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6c00, rc 0) 00000100:00100000:2.0:1788636747.628974:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207067904 00000100:00100000:2.0:1788636747.628985:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207067904 00000100:00100000:0.0:1788636747.629053:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:11352:x1875521207067776:12345-192.168.202.26@tcp:101:bash.0 Request processed in 3958us (5397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636747.629133:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 43 00010000:00010000:2.0:1788636747.629351:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce76106f/0x5b741ef42e8389cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e7 expref: 9 pid: 8438 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636747.629450:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:2.0:1788636747.629462:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03608e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2401:x1875521207067904:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636747.629487:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636747.629519:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce76106f/0x5b741ef42e8389cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e7 expref: 9 pid: 8438 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.629534:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce76106f/0x5b741ef42e8389cc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e7 expref: 9 pid: 8438 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.629577:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce76106f/0x5b741ef42e8389cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e7 expref: 9 pid: 8438 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.629599:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636747.629605:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636747.629616:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.629629:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.629697:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636747.629718:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f1ec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1875521226026880:192.168.202.26@tcp:105: 00000100:00100000:2.0:1788636747.629917:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788636747.637295:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f1ec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1875521226026880:192.168.202.26@tcp:105: 00010000:00010000:2.0:1788636747.637348:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636747.637522:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03608e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207067904:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 8060us (8795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636747.637536:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:0.0:1788636747.640218:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636747.640357:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207068160 00000100:00100000:1.0:1788636747.640374:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207068160 00000100:00100000:1.0:1788636747.640460:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:1.0:1788636747.640473:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:11352:x1875521207068160:12345-192.168.202.26@tcp:35:bash.0 00000100:00100000:1.0:1788636747.641578:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:11352:x1875521207068160:12345-192.168.202.26@tcp:35:bash.0 Request processed in 1100us (1363us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788636747.641590:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:1.0:1788636747.784587:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.784780:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207068288 00000100:00100000:3.0:1788636747.784798:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207068288 00000100:00100000:3.0:1788636747.784939:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 108 00000100:00100000:3.0:1788636747.784953:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:11368:x1875521207068288:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636747.784991:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636747.785021:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8389da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390f5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.785118:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8389e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.785139:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8389e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.785154:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8389e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636747.785226:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788636747.785231:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636747.785699:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8389e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.785744:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8389da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390f5 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.785768:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8389e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390f5 expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.785776:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:3.0:1788636747.785799:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636747.785804:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9800, rc 0) 00000100:00100000:3.0:1788636747.785967:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03608380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+39:11368:x1875521207068288:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1017us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636747.785975:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 108 00000100:00100000:2.0:1788636747.792508:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636747.792721:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207068544 00000100:00100000:0.0:1788636747.792751:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207068544 00000100:00100000:0.0:1788636747.792905:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 109 00000100:00100000:0.0:1788636747.792922:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+39:11368:x1875521207068544:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636747.792961:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636747.792997:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e8389e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef390fc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.793181:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8389ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.793203:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8389ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.793224:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8389ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636747.793240:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788636747.793452:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e8389e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390fc expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.793476:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8389ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390fc expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.793511:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef021c6f00) 00010000:00010000:0.0:1788636747.793515:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636747.793521:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6000, rc 0) 00000100:00100000:0.0:1788636747.793618:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+41:11368:x1875521207068544:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 700us (1134us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788636747.793627:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 109 00000100:00100000:0.0:1788636747.808216:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.808519:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207068672 00000100:00100000:3.0:1788636747.808534:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207068672 00000100:00100000:3.0:1788636747.808647:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:3.0:1788636747.808662:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+41:2401:x1875521207068672:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636747.808689:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636747.808738:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8389ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390fc expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.808766:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef021c6f00) 00010000:00010000:3.0:1788636747.808773:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636747.808922:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+40:2401:x1875521207068672:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 263us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636747.808930:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:0.0:1788636747.809096:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.809946:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207068928 00000100:00100000:3.0:1788636747.809957:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207068928 00000100:00100000:3.0:1788636747.810033:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 110 00000100:00100000:3.0:1788636747.810044:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+40:11368:x1875521207068928:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636747.810078:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636747.810104:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8389fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39103 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.810258:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.810501:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.810519:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636747.810619:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788636747.811099:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e8389fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39103 expref: 43 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.811127:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a04 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39103 expref: 42 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.811137:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef021c6f00) 00010000:00010000:3.0:1788636747.811140:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788636747.811144:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8a00, rc 0) 00000100:00100000:3.0:1788636747.811687:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+42:11368:x1875521207068928:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1193us (2138us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788636747.811701:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 110 00000100:00100000:0.0:1788636747.819224:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636747.819669:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207069056 00000100:00100000:1.0:1788636747.819686:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207069056 00000100:00100000:1.0:1788636747.819799:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 44 00000100:00100000:1.0:1788636747.819836:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2400:x1875521207069056:12345-192.168.202.26@tcp:1:lfs.0 00010000:00010000:1.0:1788636747.819930:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.819996:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.820007:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636747.820013:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636747.820019:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.820084:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.820105:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 8 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636747.820127:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0360b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875521226027008:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636747.820292:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636747.834722:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0360b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875521226027008:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636747.834769:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636747.839609:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636747.839736:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207069184 00000100:00100000:1.0:1788636747.839753:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207069184 00002000:00100000:1.0:1788636747.839881:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9cef040f2300 x1875521207069184/t0(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:233/0 lens 504/0 e 0 to 0 dl 1788636758 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636747.839895:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef040f2300 with x1875521207069184 ext(0->8) 00010000:00010000:1.0:1788636747.839907:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 9 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.839927:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 9 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636747.839955:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cef040f2300 00000100:00100000:1.0:1788636747.839997:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 1 00000100:00100000:1.0:1788636747.840008:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2401:x1875521207069184:12345-192.168.202.26@tcp:4:lfs.0 00000100:00100000:1.0:1788636747.843124:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:2401:x1875521207069184:12345-192.168.202.26@tcp:4:lfs.0 Request processed in 3098us (3518us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788636747.843144:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 1 00002000:00100000:1.0:1788636747.843160:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9cef040f2300 x1875521207069184/t4294967303(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:233/0 lens 504/448 e 0 to 0 dl 1788636758 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636747.843171:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef040f2300 with x1875521207069184 ext(0->8) 00010000:00010000:1.0:1788636747.843185:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 11 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.843206:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 11 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636747.843214:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cef040f2300 00000100:00100000:1.0:1788636747.845460:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.846634:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207069312 00000100:00100000:2.0:1788636747.846658:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207069312 00010000:00010000:2.0:1788636747.847114:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 11 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636747.847332:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 68 00000100:00100000:2.0:1788636747.847348:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:2400:x1875521207069312:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636747.847372:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788636747.848330:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788636747.848342:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788636747 00002000:00010000:2.0:1788636747.848345:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788636748 00002000:00010000:2.0:1788636747.848348:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788636747 00002000:00010000:2.0:1788636747.848351:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788636747.848368:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 11 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.848391:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 11 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.848425:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e8389d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390ee expref: 11 pid: 8436 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.848897:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636747.848903:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636747.848912:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.848926:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636747.849087:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636747.849176:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:2400:x1875521207069312:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 1830us (3727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636747.849189:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 68 00010000:00010000:1.0:1788636747.850562:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.850585:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.850712:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.850922:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.850935:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.850944:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636747.850951:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.850961:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.850991:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636747.851001:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a80d47e/0x5b741ef42e838a12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636747.851249:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2400:x1875521207069056:12345-192.168.202.26@tcp:1:lfs.0 Request processed in 31402us (32029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636747.851261:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 44 00000100:00100000:1.0:1788636747.853361:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.854108:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207069568 00000100:00100000:3.0:1788636747.854125:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207069568 00000100:00100000:3.0:1788636747.854237:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:3.0:1788636747.854252:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+42:11368:x1875521207069568:12345-192.168.202.26@tcp:35:lfs.0 00000004:00010000:3.0:1788636747.854357:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a04 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39103 expref: 42 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636747.854703:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788636747.854764:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788636747.857415:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1788636747.857547:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.857577:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e0 expref: 46 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.857590:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.857648:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e0 expref: 46 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.857672:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e0 expref: 46 pid: 11089 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636747.857694:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1875521226027136:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636747.858651:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636747.866762:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636747.867293:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207069696 00000100:00100000:0.0:1788636747.867310:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207069696 00010000:00010000:0.0:1788636747.867394:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e0 expref: 47 pid: 11089 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636747.867469:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:0.0:1788636747.867484:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+47:2400:x1875521207069696:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636747.867511:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636747.867521:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e0 expref: 47 pid: 11089 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.867542:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e0 expref: 47 pid: 11089 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.867577:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef021c6f00) 00010000:00010000:0.0:1788636747.867592:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.867603:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.867611:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636747.867635:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636747.867715:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+47:2400:x1875521207069696:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 235us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636747.867721:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 69 00010000:00010000:3.0:1788636747.871222:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e8389be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390e0 expref: 46 pid: 11089 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636747.871283:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1875521226027136:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636747.871335:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.871347:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.871354:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636747.871588:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1788636747.871751:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1788636747.871967:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1875521226027264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788636747.872066:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636747.872109:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033240 going to sleep for 11 seconds 00000100:00100000:0.0:1788636747.872213:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226027264 00000100:00100000:0.0:1788636747.872222:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226027264 00000100:00080000:3.0:1788636747.872932:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636747.873416:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788636747.873680:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1875521226027264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788636747.874296:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6524:x1875521226027264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 590us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636747.874307:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788636747.875570:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1875521226027264:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788636747.875822:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788636747.875927:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1875521226027392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788636747.876002:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636747.882563:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636747.885684:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226027392 00000100:00100000:1.0:1788636747.885710:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226027392 00000100:00100000:1.0:1788636747.885862:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788636747.885876:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6524:x1875521226027392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788636747.888780:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6524:x1875521226027392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 2896us (12766us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788636747.888826:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788636747.889033:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1875521226027392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788636747.889136:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1788636747.889198:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.889211:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.889220:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.889226:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636747.889244:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.889254:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.889294:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef021c6f00) 00010000:00010000:3.0:1788636747.889297:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788636747.889305:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.889312:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a19 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788636747.889473:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788636747.889561:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1788636747.889577:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416700769498ns, next at 417700766056ns, rc = 0 00000001:00080000:3.0:1788636747.889585:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788636747.889610:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef021c6f00) 00010000:00010000:3.0:1788636747.889614:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788636747.889623:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a04 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39103 expref: 50 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636747.889766:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+49:11368:x1875521207069568:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 35517us (36421us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788636747.889776:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 26 00000020:00080000:3.0:1788636747.889780:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788636747.904684:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636747.906207:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207069824 00000100:00100000:3.0:1788636747.906245:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207069824 00000100:00100000:3.0:1788636747.906358:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 111 00000100:00100000:3.0:1788636747.906372:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+49:11368:x1875521207069824:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636747.906409:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636747.906628:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838a20 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3910a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.906764:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838a20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3910a expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.906783:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838a20 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3910a expref: 50 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636747.907029:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:3.0:1788636747.907034:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788636747.907041:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8600, rc 0) 00000100:00100000:3.0:1788636747.907152:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+50:11368:x1875521207069824:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 782us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636747.907160:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 111 00000100:00100000:1.0:1788636747.921991:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636747.924899:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207070080 00000100:00100000:2.0:1788636747.924928:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207070080 00000100:00100000:2.0:1788636747.925053:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:2.0:1788636747.925066:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+50:11368:x1875521207070080:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:0.0:1788636747.925415:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226027520:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.925548:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636747.925614:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226028032:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.925652:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636747.925677:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226028544:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.925707:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636747.925753:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788636747.925761:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226027904:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.925845:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636747.925872:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226028416:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.925901:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636747.925917:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226028928:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.925947:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636747.925999:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226027520 00000100:00100000:0.0:1788636747.926007:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226027520 00000100:00100000:0.0:1788636747.926064:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788636747.926074:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226027520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.926134:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226027520:12345-0@lo:400:kworker.0 Request processed in 61us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636747.926142:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788636747.926187:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226028416 00000100:00100000:0.0:1788636747.926191:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226028416 00000100:00100000:0.0:1788636747.926252:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226028928 00000100:00100000:0.0:1788636747.926258:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226028928 00000100:00100000:0.0:1788636747.926283:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788636747.926290:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226028416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.926338:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226028416:12345-0@lo:400:kworker.0 Request processed in 48us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636747.926345:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788636747.926357:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788636747.926364:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226028928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.926398:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226028928:12345-0@lo:400:kworker.0 Request processed in 35us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636747.926405:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788636747.926642:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636747.926723:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226028416:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.926736:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226028928:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.926746:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226027520:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.926787:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226028032 00000100:00100000:0.0:1788636747.926792:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226028032 00000100:00100000:0.0:1788636747.926851:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788636747.926859:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226028032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.926908:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226028032:12345-0@lo:400:kworker.0 Request processed in 51us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636747.926915:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788636747.926960:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226028032:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.926992:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226028544 00000100:00100000:0.0:1788636747.926995:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226028544 00000100:00080000:0.0:1788636747.927015:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636747.929036:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+51:11368:x1875521207070080:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 3958us (7064us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788636747.929053:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:1.0:1788636747.929424:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226027648:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.931711:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226027904 00000100:00100000:0.0:1788636747.931748:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226027904 00000100:00100000:0.0:1788636747.931862:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788636747.931877:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226028544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636747.936278:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788636747.936327:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226027904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636747.939333:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226027776:0@lo:400:kworker.0 00000100:00100000:1.0:1788636747.946552:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636747.946641:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226028160:0@lo:400:kworker.0 00000100:00100000:1.0:1788636747.946708:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636747.946722:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226028672:0@lo:400:kworker.0 00000100:00100000:1.0:1788636747.946742:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636747.946883:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636747.946892:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226029056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636747.946922:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636747.946953:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226029056 00000100:00100000:1.0:1788636747.946963:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226029056 00000100:00100000:1.0:1788636747.947058:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788636747.947069:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226029056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636747.947119:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636747.947176:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226029056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636747.947185:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788636747.947244:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226029056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636747.947301:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226027648 00000100:00100000:1.0:1788636747.947335:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226027648 00000100:00100000:1.0:1788636747.947363:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226028160 00000100:00100000:1.0:1788636747.947367:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226028160 00000100:00100000:1.0:1788636747.947383:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226028672 00000100:00100000:1.0:1788636747.947385:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226028672 00000100:00100000:1.0:1788636747.947404:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788636747.947411:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226027648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636747.947458:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226027648:12345-0@lo:400:kworker.0 Request processed in 49us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636747.947465:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788636747.947479:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788636747.947485:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226028160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636747.947514:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03608e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226028160:12345-0@lo:400:kworker.0 Request processed in 30us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636747.947520:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788636747.947531:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788636747.947536:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226028672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636747.947563:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226028672:12345-0@lo:400:kworker.0 Request processed in 28us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636747.947569:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788636747.947597:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226027648:0@lo:400:kworker.0 00000100:00100000:1.0:1788636747.947609:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226028160:0@lo:400:kworker.0 00010000:00080000:1.0:1788636747.947623:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef04086680 x1875521226028672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636747.947635:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226028672:0@lo:400:kworker.0 00000100:00080000:1.0:1788636747.951551:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636747.951564:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636747.951569:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636747.956983:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226028544:0@lo:400:kworker.0 00000100:00100000:1.0:1788636747.957854:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0351aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226029184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636747.962971:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226027904:12345-0@lo:400:kworker.0 Request processed in 25430us (35879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636747.963010:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788636747.963204:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226027904:0@lo:400:kworker.0 00000100:00100000:3.0:1788636747.974311:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636747.974427:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226028288:0@lo:400:kworker.0 00000100:00100000:3.0:1788636747.974496:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636747.974534:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226028800:0@lo:400:kworker.0 00000100:00100000:3.0:1788636747.974559:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636747.974623:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226028288 00000100:00100000:3.0:1788636747.974633:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226028288 00000100:00100000:3.0:1788636747.974705:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788636747.974714:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226028288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636747.974778:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226028288:12345-0@lo:400:kworker.0 Request processed in 64us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636747.974787:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788636747.974855:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226028800 00000100:00100000:3.0:1788636747.974859:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226028800 00000100:00100000:3.0:1788636747.974885:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788636747.975191:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226028800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636747.975231:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226028800:12345-0@lo:400:kworker.0 Request processed in 339us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636747.975237:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1788636747.975256:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788636747.975288:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0362c380 x1875521226028288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636747.975304:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226028288:0@lo:400:kworker.0 00000100:00100000:3.0:1788636747.975327:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226028800:0@lo:400:kworker.0 00000100:00100000:2.0:1788636747.975600:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226027776 00000100:00100000:2.0:1788636747.975616:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226027776 00000100:00100000:2.0:1788636747.975688:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788636747.975699:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226027776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636747.976012:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226027776:12345-0@lo:400:kworker.0 Request processed in 313us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636747.976022:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788636747.976451:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226027776:0@lo:400:kworker.0 00000100:00100000:0.0:1788636747.982613:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226028544:12345-0@lo:400:kworker.0 Request processed in 50720us (56883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636747.982635:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788636747.987037:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636747.987238:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226029184 00000100:00100000:3.0:1788636747.987262:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226029184 00000100:00100000:3.0:1788636747.987389:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788636747.987405:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226029184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636747.987459:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636747.987578:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226029184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636747.987586:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788636747.987789:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0351aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226029184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636748.076778:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636748.077286:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207070208 00000100:00100000:3.0:1788636748.077309:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207070208 00000100:00100000:3.0:1788636748.077406:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 112 00000100:00100000:3.0:1788636748.077490:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+51:11378:x1875521207070208:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:3.0:1788636748.077592:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a27 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077610:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077621:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077632:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077638:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077643:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077726:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077734:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077740:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636748.077793:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077850:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a27 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077866:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a27 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077874:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077881:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636748.077886:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a27 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077893:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a27 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077906:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:3.0:1788636748.077909:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636748.077914:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077920:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077935:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077940:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a2e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077945:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077950:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636748.077957:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077963:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a2e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077971:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0336e600) 00010000:00010000:3.0:1788636748.077974:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636748.077977:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a2e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077984:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.077994:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.078000:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.080539:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.080547:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636748.080552:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.080562:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.080580:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:3.0:1788636748.080584:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636748.080607:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.080615:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636748.080747:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+51:11378:x1875521207070208:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 3324us (3979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636748.080758:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 112 00010000:00010000:2.0:1788636748.183797:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636748.185112:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636748.185400:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207070464 00000100:00100000:3.0:1788636748.185418:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207070464 00000100:00100000:3.0:1788636748.185533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 113 00000100:00100000:3.0:1788636748.185547:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+51:11381:x1875521207070464:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636748.185576:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636748.185608:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39111 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.185719:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a43 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.185743:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.185756:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.185766:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.185772:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.185788:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186028:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186036:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186045:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636748.186069:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788636748.186197:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a43 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186203:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a43 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186209:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186212:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636748.186216:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a43 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186222:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a43 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186235:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:3.0:1788636748.186240:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636748.186257:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186279:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838a43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186300:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186305:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186309:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186311:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636748.186313:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186328:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186334:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0336e600) 00010000:00010000:3.0:1788636748.186335:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636748.186338:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a4a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186342:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186391:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39111 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186415:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39111 expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.186423:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:3.0:1788636748.186426:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636748.186430:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8400, rc 0) 00000100:00100000:3.0:1788636748.186525:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+53:11381:x1875521207070464:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 982us (1435us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788636748.186535:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 113 00000100:00100000:1.0:1788636748.189302:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636748.189537:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207070592 00000100:00100000:2.0:1788636748.189550:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207070592 00000100:00100000:2.0:1788636748.189643:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 114 00000100:00100000:2.0:1788636748.189659:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+53:11381:x1875521207070592:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:2.0:1788636748.189772:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.189799:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.189842:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.189899:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.189908:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.189916:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.190567:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636748.190575:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.190588:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.190610:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636748.190614:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636748.190649:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.190659:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636748.191302:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+53:11381:x1875521207070592:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 1638us (2014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636748.191325:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 114 00000100:00100000:2.0:1788636748.194616:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636748.194791:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207070848 00000100:00100000:1.0:1788636748.194897:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207070848 00000100:00100000:1.0:1788636748.195079:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:1.0:1788636748.195093:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+53:11381:x1875521207070848:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:1.0:1788636748.195583:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+54:11381:x1875521207070848:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 490us (984us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788636748.195594:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:0.0:1788636748.290945:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636748.291202:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207071104 00000100:00100000:2.0:1788636748.291217:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207071104 00000100:00100000:2.0:1788636748.291683:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 115 00000100:00100000:2.0:1788636748.291701:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+54:11391:x1875521207071104:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636748.291746:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636748.291751:0:11089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788636748.291799:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8389e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390f5 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.291872:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636748.291880:0:11089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636748.291899:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a66 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39118 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.292078:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.292103:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39111 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.292141:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.292200:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39111 expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.292217:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39111 expref: 54 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636748.292239:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226029312:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636748.292655:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636748.296132:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636748.296284:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226029312:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636748.296337:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636748.296666:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207071232 00000100:00100000:1.0:1788636748.296679:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207071232 00010000:00010000:1.0:1788636748.296751:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39111 expref: 55 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636748.296934:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:0.0:1788636748.296952:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:2400:x1875521207071232:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636748.297005:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636748.297015:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39111 expref: 55 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.297032:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39111 expref: 55 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.297067:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e838a51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39111 expref: 55 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.297094:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:0.0:1788636748.297103:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.297118:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.297128:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.297168:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636748.297258:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+54:2400:x1875521207071232:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 310us (1144us total) trans 0 rc 0/0 00010000:00010000:2.0:1788636748.297341:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.297350:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636748.297377:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788636748.297570:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a66 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39118 expref: 56 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.297591:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39118 expref: 55 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.297616:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636748.297619:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636748.297622:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1e00, rc 0) 00000100:00100000:2.0:1788636748.297658:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:11391:x1875521207071104:12345-192.168.202.26@tcp:101:bash.0 Request processed in 5963us (6866us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788636748.297670:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 115 00000100:00100000:0.0:1788636748.297736:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:1.0:1788636748.301242:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636748.301544:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207071360 00000100:00100000:3.0:1788636748.301557:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207071360 00000100:00100000:3.0:1788636748.301684:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 116 00000100:00100000:3.0:1788636748.301700:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+54:11391:x1875521207071360:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636748.301736:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636748.301768:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3911f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.301872:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.301893:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.301908:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.302113:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838a7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3911f expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.302148:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3911f expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.302160:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:3.0:1788636748.302163:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636748.302167:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8a00, rc 0) 00000100:00100000:3.0:1788636748.302247:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:11391:x1875521207071360:12345-192.168.202.26@tcp:101:bash.0 Request processed in 551us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636748.302256:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 116 00000100:00100000:0.0:1788636748.307135:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636748.307242:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207071616 00000100:00100000:2.0:1788636748.307256:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207071616 00000100:00100000:2.0:1788636748.307375:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 117 00000100:00100000:2.0:1788636748.307390:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:11391:x1875521207071616:12345-192.168.202.26@tcp:36:bash.0 00010000:00010000:2.0:1788636748.307802:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.307970:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.307987:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788636748.308048:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788636748.308191:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d6e773a reply state 00000000015b4d6b transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.308207:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.308215:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636748.308218:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636748.308242:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636748.308492:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:11391:x1875521207071616:12345-192.168.202.26@tcp:36:bash.0 Request processed in 1102us (1429us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788636748.308502:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 117 00000020:00080000:2.0:1788636748.308509:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788636748.315170:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636748.315584:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207071744 00000100:00100000:2.0:1788636748.315601:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207071744 00000100:00100000:2.0:1788636748.315733:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 118 00000100:00100000:2.0:1788636748.315748:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:11391:x1875521207071744:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636748.315787:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636748.315857:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39126 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.316026:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.316046:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39118 expref: 59 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.316123:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.316178:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39118 expref: 59 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.316195:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39118 expref: 59 pid: 11089 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636748.316214:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226029440:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636748.316352:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ade40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636748.319645:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636748.319744:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207071872 00000100:00100000:3.0:1788636748.319758:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207071872 00010000:00010000:3.0:1788636748.319840:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39118 expref: 60 pid: 11089 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636748.319888:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:3.0:1788636748.319900:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:2400:x1875521207071872:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636748.319919:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636748.319928:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39118 expref: 60 pid: 11089 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.319943:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39118 expref: 60 pid: 11089 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.319973:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:3.0:1788636748.319980:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.320012:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.320022:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.320050:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636748.320136:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:2400:x1875521207071872:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 237us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636748.320145:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 71 00010000:00010000:2.0:1788636748.321626:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838a6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39118 expref: 59 pid: 11089 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636748.321662:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226029440:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636748.321709:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.321723:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.321729:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636748.321927:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788636748.321934:0:11089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636748.321973:0:11089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.322024:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838a90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39126 expref: 59 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.322043:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39126 expref: 58 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.322067:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636748.322072:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636748.322078:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1a00, rc 0) 00000100:00100000:2.0:1788636748.322203:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:11391:x1875521207071744:12345-192.168.202.26@tcp:101:bash.0 Request processed in 6458us (7051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636748.322244:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 118 00000100:00100000:1.0:1788636748.325674:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636748.325923:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207072128 00000100:00100000:3.0:1788636748.325939:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207072128 00000100:00100000:3.0:1788636748.326035:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 29 00000100:00100000:3.0:1788636748.326049:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:11391:x1875521207072128:12345-192.168.202.26@tcp:35:bash.0 00000100:00100000:3.0:1788636748.326603:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+59:11391:x1875521207072128:12345-192.168.202.26@tcp:35:bash.0 Request processed in 555us (945us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788636748.326613:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 29 00000100:00100000:3.0:1788636748.415928:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636748.416247:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207072256 00000100:00100000:1.0:1788636748.416272:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207072256 00000100:00100000:1.0:1788636748.416370:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 119 00000100:00100000:1.0:1788636748.416384:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+59:11397:x1875521207072256:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636748.416542:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636748.416576:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e838a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3912d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.416674:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838aa5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.416693:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.416707:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636748.416770:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788636748.416775:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788636748.416803:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.416865:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e838a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3912d expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.416888:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3912d expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.416899:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:1.0:1788636748.416902:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636748.416908:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37a00, rc 0) 00000100:00100000:1.0:1788636748.416999:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:11397:x1875521207072256:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 618us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636748.417008:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 119 00000100:00100000:1.0:1788636748.423495:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636748.423706:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207072384 00000100:00100000:2.0:1788636748.423720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207072384 00000100:00100000:2.0:1788636748.423845:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 120 00000100:00100000:2.0:1788636748.423862:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:11397:x1875521207072384:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636748.423893:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636748.423923:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39134 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424011:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838ab3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424043:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424059:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424074:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838aba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424083:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424090:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424194:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838ac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424228:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424236:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636748.424293:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788636748.424298:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636748.424332:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424347:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424356:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838ab3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424363:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838ab3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424370:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424376:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636748.424382:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838ab3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424390:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838ab3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424405:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636748.424409:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636748.424836:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838ab3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424844:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838ab3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424862:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838aba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424869:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838aba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424876:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838aba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424882:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636748.424885:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838aba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424892:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838aba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424902:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0336e600) 00010000:00010000:2.0:1788636748.424904:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636748.424907:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838aba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424913:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838aba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424952:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39134 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424981:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39134 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.424990:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636748.424993:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636748.424995:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1200, rc 0) 00000100:00100000:2.0:1788636748.425218:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:11397:x1875521207072384:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1358us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636748.425238:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 120 00000100:00100000:3.0:1788636748.434040:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636748.434230:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207072768 00000100:00100000:1.0:1788636748.434245:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207072768 00000100:00100000:1.0:1788636748.434350:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 8 00000100:00100000:1.0:1788636748.434364:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:2400:x1875521207072768:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636748.434389:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636748.434439:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838ac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39134 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.434469:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:1.0:1788636748.434476:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636748.434573:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:2400:x1875521207072768:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 212us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636748.434582:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 8 00000100:00100000:3.0:1788636748.439571:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636748.439712:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207072640 00000100:00100000:2.0:1788636748.439729:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207072640 00000100:00100000:2.0:1788636748.439844:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 121 00000100:00100000:2.0:1788636748.439859:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:11397:x1875521207072640:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636748.439893:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636748.439928:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ac8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3913b expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.440339:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.440362:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39126 expref: 61 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.440374:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.440499:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39126 expref: 61 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.440539:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39126 expref: 61 pid: 11089 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636748.440558:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226029568:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636748.440742:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636748.450221:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636748.450612:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207072896 00000100:00100000:1.0:1788636748.450630:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207072896 00010000:00010000:1.0:1788636748.450705:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39126 expref: 62 pid: 11089 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636748.450762:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 72 00000100:00100000:1.0:1788636748.450773:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:2401:x1875521207072896:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636748.450798:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636748.450853:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39126 expref: 62 pid: 11089 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.450875:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39126 expref: 62 pid: 11089 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.450935:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:1.0:1788636748.450942:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.450954:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.450964:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636748.450992:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636748.451185:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:2401:x1875521207072896:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 412us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636748.451195:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 72 00010000:00010000:2.0:1788636748.452095:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838a97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39126 expref: 61 pid: 11089 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636748.452126:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226029568:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636748.452163:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.452174:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.452180:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636748.452208:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788636748.452993:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ac8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3913b expref: 62 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.453022:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3913b expref: 61 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636748.453033:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636748.453403:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636748.453409:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0600, rc 0) 00000100:00100000:2.0:1788636748.453556:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:11397:x1875521207072640:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 13698us (14541us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788636748.453566:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 121 00000100:00100000:0.0:1788636748.456973:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636748.457307:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207073152 00000100:00100000:3.0:1788636748.457331:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207073152 00000100:00100000:3.0:1788636748.457579:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 9 00000100:00100000:3.0:1788636748.457597:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:11397:x1875521207073152:12345-192.168.202.26@tcp:103:lfs.0 00010000:00010000:3.0:1788636748.457619:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636748.457654:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838a20 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3910a expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.457697:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:3.0:1788636748.457705:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636748.457787:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:11397:x1875521207073152:12345-192.168.202.26@tcp:103:lfs.0 Request processed in 194us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636748.460845:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 9 00000100:00100000:0.0:1788636748.461342:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636748.461518:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207073280 00000100:00100000:3.0:1788636748.461531:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207073280 00000100:00100000:3.0:1788636748.461602:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 122 00000100:00100000:3.0:1788636748.461616:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:11397:x1875521207073280:12345-192.168.202.26@tcp:58:lfs.0 00010000:00010000:3.0:1788636748.461788:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.461835:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636748.461850:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636748.461986:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788636748.462180:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:11397:x1875521207073280:12345-192.168.202.26@tcp:58:lfs.0 Request processed in 565us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636748.462189:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 122 00000100:00100000:3.0:1788636748.464502:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636748.464617:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207073408 00000100:00100000:0.0:1788636748.464631:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207073408 00000100:00100000:0.0:1788636748.464707:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 123 00000100:00100000:0.0:1788636748.464720:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:11397:x1875521207073408:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636748.464749:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636748.464776:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838ae4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39142 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.464894:0:13298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.464910:0:13298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838ae4 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39142 expref: 61 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.464934:0:13298:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.464953:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838ae4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39142 expref: 61 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.464983:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:0.0:1788636748.464989:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636748.464993:0:13298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838ae4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39142 expref: 61 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636748.465002:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7400, rc 0) 00000100:00100000:0.0:1788636748.465096:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:11397:x1875521207073408:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 372us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636748.465105:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 123 00000001:00080000:2.0:1788636748.961882:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788636748.961904:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:2.0:1788636749.207479:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788636749.269236:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636749.269250:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636749.269395:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788636749.269416:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788636749.269786:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226029696:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636749.271012:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636749.291826:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636749.292264:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226029696:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788636749.292484:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207073536 00000100:00100000:2.0:1788636749.292496:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207073536 00000100:00080000:1.0:1788636749.292678:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636749.292800:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 124 00000100:00100000:2.0:1788636749.292850:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:11398:x1875521207073536:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788636749.292901:0:11089:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788636749.293110:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:11398:x1875521207073536:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 262us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636749.293120:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 124 00000100:00100000:1.0:1788636749.302867:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636749.303017:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207073664 00000100:00100000:2.0:1788636749.303036:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207073664 00000100:00100000:2.0:1788636749.303128:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 125 00000100:00100000:2.0:1788636749.303140:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:11398:x1875521207073664:12345-192.168.202.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788636749.303252:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aeb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303279:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303296:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303353:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838af2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303363:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838af2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303370:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838af2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303403:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303414:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303421:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636749.303495:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788636749.303501:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636749.303523:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303540:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303548:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aeb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303556:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aeb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303587:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636749.303593:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aeb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303604:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aeb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303620:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:2.0:1788636749.303623:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636749.303630:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aeb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303638:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838aeb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303659:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838af2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303665:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838af2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303672:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838af2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303677:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636749.303680:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838af2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303687:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838af2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303705:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9cef0336e000) 00010000:00010000:2.0:1788636749.303708:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636749.303712:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838af2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303719:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838af2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303737:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303743:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303749:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303755:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636749.303758:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303764:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303769:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636749.303772:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636749.303775:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.303781:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838af9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.303959:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:11398:x1875521207073664:12345-192.168.202.26@tcp:34:lhsmtool_posix.0 Request processed in 818us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636749.303968:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 125 00000100:00100000:3.0:1788636749.307356:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636749.307551:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207073920 00000100:00100000:0.0:1788636749.307565:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207073920 00000100:00100000:0.0:1788636749.307667:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 126 00000100:00100000:0.0:1788636749.307681:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:11398:x1875521207073920:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636749.307714:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636749.307747:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39149 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.307969:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.307990:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.308005:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636749.308018:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788636749.308128:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.308138:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.308170:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.308176:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636749.308182:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.308193:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.308210:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:0.0:1788636749.308214:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788636749.308221:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.308228:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.308286:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b00 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39149 expref: 63 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.308298:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:0.0:1788636749.308301:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636749.308305:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39149 expref: 63 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.308329:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6000, rc 0) 00000100:00100000:0.0:1788636749.308403:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:11398:x1875521207073920:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 725us (1061us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1788636749.308503:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 126 00000100:00100000:0.0:1788636749.315407:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636749.315587:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207074048 00000100:00100000:2.0:1788636749.315601:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207074048 00000100:00100000:2.0:1788636749.315685:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 127 00000100:00100000:2.0:1788636749.315698:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:11398:x1875521207074048:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788636749.315755:0:11089:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788636749.315978:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:11398:x1875521207074048:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 283us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636749.315988:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 127 00000100:00100000:1.0:1788636749.325109:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.325229:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207074304 00000100:00100000:3.0:1788636749.325244:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207074304 00000100:00100000:3.0:1788636749.325368:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 128 00000100:00100000:3.0:1788636749.325382:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:11398:x1875521207074304:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636749.325429:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636749.325434:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788636749.325478:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838aa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3912d expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.325509:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:3.0:1788636749.325515:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636749.325537:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838b15 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39150 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788636749.326197:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788636749.326424:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838b1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.326446:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.326461:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838b1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.326549:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838b15 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39150 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.326573:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838b1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39150 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.326584:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef0217a500) 00010000:00010000:3.0:1788636749.326604:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636749.326608:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9200, rc 0) 00000100:00100000:3.0:1788636749.326735:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+63:11398:x1875521207074304:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 1356us (1642us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788636749.326748:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 128 00000100:00100000:3.0:1788636749.333625:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636749.333766:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207074560 00000100:00100000:0.0:1788636749.333782:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207074560 00000100:00100000:0.0:1788636749.333915:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 129 00000100:00100000:0.0:1788636749.333939:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+63:11398:x1875521207074560:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788636749.334033:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636749.334076:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e838b1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39150 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334107:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef0217a500) 00010000:00010000:0.0:1788636749.334125:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636749.334154:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b2a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334172:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334184:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334202:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xaf07c1cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334209:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xaf07c1cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334217:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xaf07c1cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334300:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b2a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334308:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b2a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334326:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334332:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636749.334337:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b2a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334346:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b2a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334356:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:0.0:1788636749.334360:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636749.334365:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b2a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334372:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b2a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334382:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xaf07c1cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334388:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xaf07c1cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334394:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xaf07c1cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334405:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636749.334409:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xaf07c1cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334692:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b31 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xaf07c1cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334703:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xaf07c1cc (ffff9cef021c6b00) 00010000:00010000:0.0:1788636749.334705:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636749.334709:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b31 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xaf07c1cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.334716:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838b31 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xaf07c1cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636749.334912:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:11398:x1875521207074560:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 984us (1308us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636749.334922:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 129 00000100:00100000:2.0:1788636749.344043:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636749.351837:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207074688 00000100:00100000:1.0:1788636749.351865:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207074688 00000100:00100000:1.0:1788636749.351970:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 130 00000100:00100000:1.0:1788636749.351983:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:11398:x1875521207074688:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636749.352012:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636749.352044:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838b38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39157 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.352344:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.352384:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.352399:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.353027:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838b38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39157 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.353552:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39157 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.353566:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:1.0:1788636749.353570:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788636749.353576:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36e00, rc 0) 00000100:00100000:1.0:1788636749.353708:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+63:11398:x1875521207074688:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 1725us (9906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636749.353718:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 130 00000100:00100000:3.0:1788636749.358776:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636749.359170:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207074944 00000100:00100000:1.0:1788636749.359186:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207074944 00000100:00100000:1.0:1788636749.359271:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 131 00000100:00100000:1.0:1788636749.359293:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+63:11398:x1875521207074944:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788636749.359724:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.359746:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.359784:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636749.360551:0:13298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1788636749.360567:0:13298:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418171759004ns, next at 419171754716ns, rc = 0 00000004:00010000:1.0:1788636749.360652:0:13298:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d76c61dd reply state 00000000470f97f2 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.360671:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.360681:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:1.0:1788636749.360684:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788636749.360689:0:13298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636749.361238:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+65:11398:x1875521207074944:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 1949us (2515us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788636749.361249:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 131 00000100:00100000:3.0:1788636749.365630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636749.367164:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207075072 00000100:00100000:2.0:1788636749.367182:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207075072 00000100:00100000:2.0:1788636749.367364:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 132 00000100:00100000:2.0:1788636749.367382:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+65:11398:x1875521207075072:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636749.367556:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636749.367595:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838b4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3915e expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.367699:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838b4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3915e expref: 66 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.367719:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838b4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3915e expref: 66 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.367779:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:2.0:1788636749.367783:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636749.367790:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1400, rc 0) 00000100:00100000:2.0:1788636749.367997:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:11398:x1875521207075072:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 619us (2387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636749.368006:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 132 00000100:00100000:2.0:1788636749.379340:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636749.379660:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207075200 00000100:00100000:0.0:1788636749.379678:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207075200 00000100:00100000:0.0:1788636749.379784:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 45 00000100:00100000:0.0:1788636749.379800:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207075200:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788636749.380281:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2401:x1875521207075200:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 Request processed in 484us (984us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788636749.380293:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 45 00000100:00080000:1.0:1788636749.383024:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636749.398205:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636749.398792:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207075456 00000100:00100000:2.0:1788636749.398848:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207075456 00000100:00100000:2.0:1788636749.398945:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 30 00000100:00100000:2.0:1788636749.398961:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:11398:x1875521207075456:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788636749.399279:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:11398:x1875521207075456:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 320us (1088us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788636749.399288:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 30 00000100:00100000:3.0:1788636749.404010:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636749.414264:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207075712 00000100:00100000:1.0:1788636749.414298:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207075712 00000100:00100000:1.0:1788636749.414592:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 133 00000100:00100000:1.0:1788636749.414610:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:11398:x1875521207075712:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788636749.414828:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:11398:x1875521207075712:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 202us (10819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636749.417194:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.417304:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207075840 00000100:00100000:3.0:1788636749.417324:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207075840 00000100:00100000:1.0:1788636749.425191:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 133 00000100:00100000:3.0:1788636749.427472:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 134 00000100:00100000:3.0:1788636749.427513:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:11398:x1875521207075840:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636749.427551:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636749.427594:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838b54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39165 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.427717:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838b5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.427737:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.427754:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636749.427843:0:13298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636749.427867:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838b5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.427927:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838b54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39165 expref: 69 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.427951:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838b5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39165 expref: 68 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.427963:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:3.0:1788636749.427966:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788636749.427971:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9400, rc 0) 00000100:00100000:3.0:1788636749.428081:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+68:11398:x1875521207075840:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 589us (10899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636749.428090:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 134 00000100:00100000:3.0:1788636749.434175:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636749.434688:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207075968 00000100:00100000:1.0:1788636749.434725:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207075968 00000100:00100000:1.0:1788636749.434849:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 46 00000100:00100000:1.0:1788636749.434863:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2401:x1875521207075968:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636749.434889:0:9847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636749.434917:0:9847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001791573c/0x5b741ef42e838b62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3916c expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636749.434953:0:9847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c6e4d, blocks: 0x0 00010000:00010000:1.0:1788636749.434979:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:1.0:1788636749.434984:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636749.434997:0:9847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001791573c/0x5b741ef42e838b62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3916c expref: 10 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.435129:0:9847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001791573c/0x5b741ef42e838b62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3916c expref: 10 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.435147:0:9847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36c00, rc 0) 00000100:00100000:1.0:1788636749.435350:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:2401:x1875521207075968:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 491us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636749.435359:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 46 00000100:00100000:2.0:1788636749.447245:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.447337:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207076224 00000100:00100000:3.0:1788636749.447351:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207076224 00000100:00100000:3.0:1788636749.447443:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 135 00000100:00100000:3.0:1788636749.447456:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+68:11398:x1875521207076224:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788636749.447619:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+68:11398:x1875521207076224:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 165us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636749.447629:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 135 00000100:00100000:0.0:1788636749.464999:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.465708:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207076352 00000100:00100000:3.0:1788636749.465726:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207076352 00000100:00100000:3.0:1788636749.466394:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 47 00000100:00100000:3.0:1788636749.466414:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:11398:x1875521207076352:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636749.466519:0:9845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636749.466635:0:9845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39173 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.466693:0:9845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001791573c/0x5b741ef42e838b62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3916c expref: 11 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.466705:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636749.466711:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636749.466719:0:9845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 11 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.466778:0:9845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001791573c/0x5b741ef42e838b62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3916c expref: 11 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.466801:0:9845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001791573c/0x5b741ef42e838b62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3916c expref: 11 pid: 9847 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636749.466852:0:9845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9845:1875521226029824:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636749.467463:0:9845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636749.476180:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.476737:0:9845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9845:1875521226029824:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636749.476800:0:9845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 11 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.476860:0:9845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8600, rc 0) 00000100:00100000:3.0:1788636749.477015:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:11398:x1875521207076352:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 10608us (12031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636749.477061:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 47 00000100:00100000:0.0:1788636749.477265:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207076480 00000100:00100000:0.0:1788636749.477275:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207076480 00010000:00010000:0.0:1788636749.477333:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001791573c/0x5b741ef42e838b62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3916c expref: 11 pid: 9847 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636749.477376:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 73 00000100:00100000:0.0:1788636749.477388:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:2401:x1875521207076480:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636749.477407:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636749.477722:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001791573c/0x5b741ef42e838b62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3916c expref: 11 pid: 9847 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.477740:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001791573c/0x5b741ef42e838b62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3916c expref: 11 pid: 9847 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.477779:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001791573c/0x5b741ef42e838b62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3916c expref: 11 pid: 9847 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.477798:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636749.477804:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636749.477865:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 10 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.477879:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 10 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.477928:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 10 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636749.477958:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03792300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1875521226029952:192.168.202.26@tcp:105: 00000100:00100000:0.0:1788636749.478036:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636749.486120:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03792300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1875521226029952:192.168.202.26@tcp:105: 00010000:00010000:1.0:1788636749.486166:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636749.486399:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:2401:x1875521207076480:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 9009us (10228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636749.486414:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 73 00000100:00100000:2.0:1788636749.490998:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636749.491878:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207076608 00000100:00100000:1.0:1788636749.491894:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207076608 00002000:00100000:1.0:1788636749.491973:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9cf03fccfb80 x1875521207076608/t0(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:235/0 lens 504/0 e 0 to 0 dl 1788636760 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636749.491986:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf03fccfb80 with x1875521207076608 ext(0->12) 00002000:00010000:1.0:1788636749.491994:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cf03fccfb80 00000100:00100000:1.0:1788636749.492039:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 2 00000100:00100000:1.0:1788636749.492126:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:2400:x1875521207076608:12345-192.168.202.26@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788636749.497870:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+12:2400:x1875521207076608:12345-192.168.202.26@tcp:4:lhsmtool_posix.0 Request processed in 5801us (6873us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788636749.497893:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 2 00002000:00100000:1.0:1788636749.497911:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9cf03fccfb80 x1875521207076608/t4294967309(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:235/0 lens 504/448 e 0 to 0 dl 1788636760 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636749.497922:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf03fccfb80 with x1875521207076608 ext(0->12) 00002000:00010000:1.0:1788636749.497932:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cf03fccfb80 00000100:00100000:3.0:1788636749.507534:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636749.508514:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207076736 00000100:00100000:1.0:1788636749.508530:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207076736 00000100:00100000:1.0:1788636749.508631:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 136 00000100:00100000:1.0:1788636749.508644:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+68:11398:x1875521207076736:12345-192.168.202.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788636749.511892:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1788636749.511921:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788636749.511975:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788636749.511999:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cef02033240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788636749.512006:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cef0340f600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cef02033600 00000020:00080000:2.0:1788636749.512010:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cef0340f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cef026abe00 00000004:00080000:2.0:1788636749.512042:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788636749.512089:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cef0219b9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788636749.512110:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cef024d9400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cef0219bc00 00000020:00080000:2.0:1788636749.512113:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cef024d9d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf002f2a400 00000020:00080000:1.0:1788636749.512403:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788636749.512508:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788636749.512535:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226030208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788636749.512612:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11398:x1875521207076736:12345-192.168.202.26@tcp:44:lhsmtool_posix.0 Request processed in 3966us (5206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636749.512626:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 136 00000100:00100000:1.0:1788636749.512629:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636749.512696:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636749.512703:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226030336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788636749.512744:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636749.512756:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226030208 00000100:00100000:0.0:1788636749.512766:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226030208 00000100:00100000:1.0:1788636749.512778:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226030336 00000100:00100000:1.0:1788636749.512781:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226030336 00000100:00100000:0.0:1788636749.512871:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788636749.512882:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521226030208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788636749.512958:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226030080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788636749.512994:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636749.513037:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226030080 00000100:00100000:2.0:1788636749.513042:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226030080 00000100:00100000:2.0:1788636749.513073:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788636749.513081:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1875521226030080:12345-0@lo:6:osp-syn-1-0.0 00002000:00010000:0.0:1788636749.513221:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788636749.513226:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788636749 00002000:00010000:0.0:1788636749.513228:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788636749.513230:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788636749 -> 1788636749 00002000:00010000:0.0:1788636749.513233:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788636749.513284:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1875521226030208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 403us (655us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788636749.513291:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00002000:00080000:2.0:1788636749.513329:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1788636749.513360:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.513392:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcad6001/0x5b741ef42e838924 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390cb expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.513403:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788636749.513409:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636749.513415:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.513550:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bcad6001/0x5b741ef42e838924 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390cb expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.513623:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bcad6001/0x5b741ef42e838924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390cb expref: 11 pid: 8437 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.513653:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875521226030464:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636749.513711:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad300 going to sleep for 11 seconds 00000100:00080000:0.0:1788636749.513903:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636749.513908:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788636749.514005:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514016:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514024:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514031:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636749.514037:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514047:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636749.514161:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788636749.514174:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226030336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788636749.514196:0:9847:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1788636749.514358:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9cef0331ce00) 00010000:00010000:3.0:1788636749.514361:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636749.514367:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514375:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83886e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514417:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514424:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514449:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514454:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636749.514457:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514463:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514471:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9cef0331cc00) 00010000:00010000:3.0:1788636749.514473:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636749.514476:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514482:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838916 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514499:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514505:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514511:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514515:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636749.514518:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514532:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514540:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0336e600) 00010000:00010000:3.0:1788636749.514542:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636749.514545:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.514550:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838994 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636749.514739:0:9847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c6e4b, atime: 0x6a9c6e4c, ctime: 0x6a9c6e4b, blocks: 0x8 00010000:00010000:1.0:1788636749.514747:0:9847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f58e7acb/0x5b741ef42e838b77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.514760:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=418s v=(0 0) 00010000:00010000:1.0:1788636749.514764:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636749.514771:0:9847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f58e7acb/0x5b741ef42e838b77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.514788:0:9847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f58e7acb/0x5b741ef42e838b77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.514798:0:9847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f58e7acb/0x5b741ef42e838b77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.514831:0:9847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f58e7acb/0x5b741ef42e838b77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.514855:0:9847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788636749.515075:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521226030336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 904us (2328us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788636749.515095:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788636749.515162:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515171:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515177:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515183:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636749.515186:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515193:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515202:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef0336e600) 00010000:00010000:3.0:1788636749.515205:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636749.515208:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515233:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8389b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515262:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515270:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515276:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515281:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636749.515285:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515292:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515301:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:3.0:1788636749.515304:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636749.515307:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515323:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838a89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515336:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515343:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515355:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515360:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636749.515364:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515371:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515379:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:3.0:1788636749.515382:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788636749.515385:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.515392:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838b46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636749.516533:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788636749.516546:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:0.0:1788636749.516578:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf03fcadf80, transno 4294967302 00000004:00080000:0.0:1788636749.516591:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:0.0:1788636749.516614:0:3648:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cef03793800 x1875521226030336/t4294967305(4294967305) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788636765 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788636749.516647:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cef03793800/2, rc 0, transno 4294967305 00000100:00100000:0.0:1788636749.516652:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226030336:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788636749.516743:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cef03244000/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788636749.516750:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226030208:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788636749.516897:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636749.516910:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f58e7acb/0x5b741ef42e838b77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.516922:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636749.516927:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f58e7acb/0x5b741ef42e838b77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.516938:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f58e7acb/0x5b741ef42e838b77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.516960:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f58e7acb/0x5b741ef42e838b77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.516968:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f58e7acb/0x5b741ef42e838b77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.516992:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636749.516994:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636749.516995:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636749.521899:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636749.521944:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.522175:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207076992 00000100:00100000:3.0:1788636749.522192:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207076992 00000100:00100000:1.0:1788636749.522678:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207076864 00000100:00100000:1.0:1788636749.522684:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207076864 00010000:00010000:1.0:1788636749.522750:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bcad6001/0x5b741ef42e838924 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390cb expref: 13 pid: 8437 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636749.522832:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 74 00000100:00100000:1.0:1788636749.522846:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:2401:x1875521207076864:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636749.522876:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636749.522884:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bcad6001/0x5b741ef42e838924 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390cb expref: 13 pid: 8437 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.522901:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bcad6001/0x5b741ef42e838924 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390cb expref: 13 pid: 8437 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.522937:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636749.522942:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636749.522950:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.522962:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.522987:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636749.523139:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcad6001/0x5b741ef42e838924 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390cb expref: 13 pid: 8437 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.523194:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875521226030464:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636749.523236:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636749.523760:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 51 00000100:00100000:3.0:1788636749.523772:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+12:2401:x1875521207076992:12345-192.168.202.26@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788636749.524978:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.524991:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.525005:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.525014:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.525050:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788636749.526645:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+12:2401:x1875521207076864:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 3783us (4680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636749.526693:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 74 00010000:00010000:3.0:1788636749.527081:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636749.527094:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.527111:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636749.527118:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.527141:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.527170:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.527180:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.527224:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636749.527227:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636749.527229:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636749.529230:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1875521226030080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16130us (16215us total) trans 4294967311 rc 0/0 00000004:00080000:0.0:1788636749.529893:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cef03245f80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788636749.529904:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03245f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226030080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788636749.531017:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000001:00080000:3.0:1788636749.531669:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1788636749.531683:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1788636749.532376:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207076992:12345-192.168.202.26@tcp:16:lhsmtool_posix.0 Request processed in 8594us (10481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636749.532396:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 51 00000100:00100000:0.0:1788636749.537006:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.537324:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207077248 00000100:00100000:3.0:1788636749.537342:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207077248 00000100:00100000:3.0:1788636749.537656:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 137 00000100:00100000:3.0:1788636749.537671:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:11398:x1875521207077248:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636749.537777:0:13298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636749.537858:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838b5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39165 expref: 16 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.537892:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:3.0:1788636749.537899:0:13298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636749.537947:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.537992:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.538006:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636749.538232:0:13298:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b9ea3fe reply state 00000000267ab820 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.538255:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.538264:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:3.0:1788636749.538268:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788636749.538271:0:13298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636749.538623:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:11398:x1875521207077248:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 891us (1571us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788636749.538634:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 137 00000100:00100000:2.0:1788636749.542931:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.543036:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207077376 00000100:00100000:3.0:1788636749.543059:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207077376 00000100:00100000:3.0:1788636749.543136:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:3.0:1788636749.543149:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207077376:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788636749.543951:0:9847:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788636749.543959:0:9847:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788636749 -> 1788636748 00002000:00010000:3.0:1788636749.543963:0:9847:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788636748 00002000:00010000:3.0:1788636749.543966:0:9847:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788636749 -> 1788636748 00002000:00010000:3.0:1788636749.543968:0:9847:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788636749.544177:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207077376:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 Request processed in 1027us (1258us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788636749.544210:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:0.0:1788636749.548032:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.548889:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207077632 00000100:00100000:3.0:1788636749.548906:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207077632 00000100:00100000:3.0:1788636749.549002:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 138 00000100:00100000:3.0:1788636749.549017:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:11398:x1875521207077632:12345-192.168.202.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788636749.549152:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.549176:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39157 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.549188:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.549240:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39157 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.550114:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39157 expref: 17 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636749.550135:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226030592:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636749.550894:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033840 going to sleep for 11 seconds 00000100:00100000:0.0:1788636749.557140:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636749.557247:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207077760 00000100:00100000:1.0:1788636749.557268:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207077760 00010000:00010000:1.0:1788636749.557336:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39157 expref: 18 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636749.557389:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 75 00000100:00100000:1.0:1788636749.557400:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2400:x1875521207077760:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636749.557424:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636749.557654:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39157 expref: 18 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.557674:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39157 expref: 18 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.557706:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:1.0:1788636749.557713:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.557727:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.557736:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.557770:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636749.557884:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2400:x1875521207077760:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 486us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636749.557911:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 75 00010000:00010000:2.0:1788636749.558118:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838b3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39157 expref: 17 pid: 6521 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.558153:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226030592:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636749.558183:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.558196:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.558203:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.558273:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.558281:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.558289:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.558295:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636749.558301:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.558322:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.558333:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:2.0:1788636749.558335:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788636749.558339:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.558353:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e838b85 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.558403:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:11398:x1875521207077632:12345-192.168.202.26@tcp:55:lhsmtool_posix.0 Request processed in 9390us (10390us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788636749.558413:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 138 00000100:00100000:3.0:1788636749.562897:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636749.563001:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207077888 00000100:00100000:2.0:1788636749.563015:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207077888 00000100:00100000:2.0:1788636749.563096:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 53 00000100:00100000:2.0:1788636749.563108:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207077888:12345-192.168.202.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788636749.563168:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.563194:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.563204:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636749.563209:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636749.563225:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.563288:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 7 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.563304:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 7 pid: 9845 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.563362:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1875521226030720:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636749.564840:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad000 going to sleep for 11 seconds 00000100:00100000:3.0:1788636749.569391:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1875521226030720:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636749.569681:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636749.571199:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.572521:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207078016 00000100:00100000:3.0:1788636749.572539:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207078016 00010000:00010000:3.0:1788636749.572674:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 8 pid: 9845 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636749.572731:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 76 00000100:00100000:3.0:1788636749.572742:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207078016:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636749.572764:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636749.572795:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 8 pid: 9845 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.572842:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 8 pid: 9845 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.572871:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b38ef2a4/0x5b741ef42e838b69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39173 expref: 8 pid: 9845 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.572892:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636749.572897:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636749.572904:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.572916:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.573161:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636749.573256:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207078016:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 515us (2069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636749.573274:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 76 00010000:00010000:2.0:1788636749.582941:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.582971:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.584419:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.584453:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.584464:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.584471:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636749.584477:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.584488:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.584545:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.584554:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e838b8c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.584740:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207077888:12345-192.168.202.26@tcp:1:lhsmtool_posix.0 Request processed in 21626us (21849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636749.584755:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 53 00000100:00100000:1.0:1788636749.593024:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636749.593666:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207078272 00000100:00100000:0.0:1788636749.593699:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207078272 00000100:00100000:0.0:1788636749.593785:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 139 00000100:00100000:0.0:1788636749.593797:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:11398:x1875521207078272:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788636749.593955:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.593978:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3911f expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.593989:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.594075:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3911f expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.594094:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3911f expref: 16 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636749.594116:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226030848:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636749.594747:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636749.603579:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636749.603800:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207078400 00000100:00100000:1.0:1788636749.603857:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207078400 00010000:00010000:1.0:1788636749.603918:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3911f expref: 17 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636749.603962:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 77 00000100:00100000:1.0:1788636749.603974:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:2401:x1875521207078400:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636749.603994:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636749.604003:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3911f expref: 17 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.604019:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3911f expref: 17 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.604064:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:1.0:1788636749.604072:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838ae4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39142 expref: 17 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.604086:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.604096:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.604131:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636749.604160:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636749.604251:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:2401:x1875521207078400:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 271us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636749.604259:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 77 00010000:00010000:2.0:1788636749.604949:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838a82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3911f expref: 16 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.604973:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226030848:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636749.605003:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.605013:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.605020:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.605424:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.605515:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838b4d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3915e expref: 16 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.605550:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.605902:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838b4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3915e expref: 16 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.605920:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838b4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3915e expref: 16 pid: 11089 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.605939:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226030976:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636749.606044:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636749.614119:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.614272:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207078528 00000100:00100000:3.0:1788636749.614285:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207078528 00010000:00010000:3.0:1788636749.614376:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838b4d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3915e expref: 17 pid: 11089 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636749.614432:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 78 00000100:00100000:3.0:1788636749.614443:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:2400:x1875521207078528:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636749.614463:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636749.614470:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838b4d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3915e expref: 17 pid: 11089 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.614485:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838b4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3915e expref: 17 pid: 11089 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.614512:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:3.0:1788636749.614517:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.614529:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.614538:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.614593:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636749.614682:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:2400:x1875521207078528:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 240us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636749.614691:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 78 00010000:00010000:2.0:1788636749.617151:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838b4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3915e expref: 16 pid: 11089 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.617187:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226030976:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636749.617345:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.617514:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.617523:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636749.617774:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788636749.617963:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788636749.618324:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788636749.618471:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1875521226031104:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788636749.618575:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636749.618624:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00944e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636749.618851:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226031104 00000100:00100000:2.0:1788636749.618862:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226031104 00000100:00100000:2.0:1788636749.618931:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788636749.618942:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1875521226031104:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788636749.619075:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1875521226031104:12345-0@lo:1000:mdt00_000.0 Request processed in 134us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636749.619085:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788636749.619783:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788636749.619792:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1788636749.619845:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cef03244000, transno 4294967310 00000100:00100000:0.0:1788636749.619868:0:6521:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cef03245f80 x1875521226030080/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788636765 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636749.619913:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1875521226031104:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788636749.620382:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788636749.620479:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1875521226031232:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788636749.620544:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636749.621001:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef03692000 going to sleep for 11 seconds 00000100:00100000:3.0:1788636749.621369:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226031232 00000100:00100000:3.0:1788636749.621382:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226031232 00000100:00100000:3.0:1788636749.621558:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788636749.621646:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1875521226031232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788636749.622015:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6521:x1875521226031232:12345-0@lo:1000:mdt00_000.0 Request processed in 363us (1458us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788636749.622024:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788636749.622970:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1875521226031232:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788636749.623152:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623166:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623176:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623182:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636749.623188:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623198:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623338:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:0.0:1788636749.623343:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636749.623350:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623357:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0a00/0x5b741ef42e838b9a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623636:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623645:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623652:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623658:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636749.623661:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623668:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623679:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:0.0:1788636749.623681:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636749.623691:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838ae4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39142 expref: 19 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623707:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838ae4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39142 expref: 19 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623718:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39142 expref: 19 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.623773:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838ae4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39142 expref: 19 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636749.623804:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226031360:192.168.202.26@tcp:105: 00000100:00100000:0.0:1788636749.624183:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef03692000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636749.629382:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636749.629583:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207078656 00000100:00100000:2.0:1788636749.629617:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207078656 00000100:00100000:2.0:1788636749.629692:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 31 00000100:00100000:2.0:1788636749.629704:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:11397:x1875521207078656:12345-192.168.202.26@tcp:49:lfs.0 00000100:00100000:2.0:1788636749.629902:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:11397:x1875521207078656:12345-192.168.202.26@tcp:49:lfs.0 Request processed in 199us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636749.629910:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 31 00000100:00100000:3.0:1788636749.638842:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226031360:192.168.202.26@tcp:105: 00010000:00010000:3.0:1788636749.638894:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.638909:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838add lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641167:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ba1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641201:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641229:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641253:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ba1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641260:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ba1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641267:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ba1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641274:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636749.641279:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ba1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641287:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ba1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641301:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636749.641333:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636749.641341:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ba1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641349:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838ba1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641371:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641379:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641386:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641392:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636749.641396:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641402:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641421:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636749.641423:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788636749.641426:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.641432:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838b93 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636749.641888:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:11398:x1875521207078272:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 48084us (48874us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788636749.641912:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 139 00000020:00080000:2.0:1788636749.641921:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788636749.642186:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636749.642193:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636749.642920:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788636749.642936:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636749.643937:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636749.644258:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207078912 00000100:00100000:1.0:1788636749.644272:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207078912 00000100:00100000:1.0:1788636749.644353:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 140 00000100:00100000:1.0:1788636749.644365:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:11397:x1875521207078912:12345-192.168.202.26@tcp:58:lfs.0 00000040:00080000:1.0:1788636749.644796:0:13298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788636749.644917:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:11397:x1875521207078912:12345-192.168.202.26@tcp:58:lfs.0 Request processed in 553us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636749.644925:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 140 00000100:00100000:2.0:1788636749.652905:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.654472:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207079168 00000100:00100000:3.0:1788636749.654491:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207079168 00000100:00100000:3.0:1788636749.654597:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 32 00000100:00100000:3.0:1788636749.654611:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:11398:x1875521207079168:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788636749.655049:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788636749.655092:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1788636749.655131:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.655171:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.655185:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.655195:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.655202:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.655209:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636749.655230:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788636749.655376:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:11398:x1875521207079168:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 767us (2486us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788636749.655386:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 32 00000020:00080000:3.0:1788636749.655392:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788636749.656458:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636749.656471:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.656484:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636749.656490:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.656500:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.656517:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:2.0:1788636749.656521:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788636749.656527:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.656535:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838ba8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.656554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636749.656556:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636749.656569:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636749.707195:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636749.707401:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207079296 00000100:00100000:0.0:1788636749.707479:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207079296 00000100:00100000:0.0:1788636749.707566:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 141 00000100:00100000:0.0:1788636749.707580:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:11400:x1875521207079296:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636749.707616:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636749.707646:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838baf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3917a expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.707733:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838bb6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.707751:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.707765:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.707782:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838bbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.707789:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.707795:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.707970:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.707983:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3913b expref: 22 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.707994:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.708043:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3913b expref: 22 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.708060:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3913b expref: 22 pid: 11089 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636749.708080:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226031488:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636749.708683:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef03692cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636749.712943:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226031488:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636749.712983:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636749.713140:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636749.713629:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207079552 00000100:00100000:3.0:1788636749.713641:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207079552 00000100:00100000:3.0:1788636749.713780:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:3.0:1788636749.713795:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:6172:x1875521207079552:12345-192.168.202.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788636749.714171:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:6172:x1875521207079552:12345-192.168.202.26@tcp:35:ldlm_bl.0 Request processed in 377us (1364us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788636749.714180:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:2.0:1788636749.725954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636749.726125:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207079680 00000100:00100000:0.0:1788636749.726138:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207079680 00010000:00010000:0.0:1788636749.726202:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3913b expref: 24 pid: 11089 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636749.726260:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 79 00000100:00100000:0.0:1788636749.726272:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:2401:x1875521207079680:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636749.726292:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636749.726300:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3913b expref: 24 pid: 11089 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.726347:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3913b expref: 24 pid: 11089 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.726377:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838acf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3913b expref: 24 pid: 11089 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.726398:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:0.0:1788636749.726405:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.726641:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.726652:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636749.726695:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636749.726782:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:2401:x1875521207079680:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 512us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636749.726791:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 79 00010000:00010000:2.0:1788636749.729535:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729557:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636749.729640:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788636749.729647:0:11089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636749.729677:0:11089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729698:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729711:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729718:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838bb6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729727:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729733:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636749.729738:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729877:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838bb6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729898:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:2.0:1788636749.729928:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636749.729936:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838bb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729944:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838bb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729982:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838bbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729989:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838bbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.729996:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838bbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.730110:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636749.730115:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838bbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.730123:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838bbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.730132:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9cef021c6b00) 00010000:00010000:2.0:1788636749.730135:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636749.730139:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838bbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.730145:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838bbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.730205:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838baf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3917a expref: 23 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.730236:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3917a expref: 22 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636749.730244:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636749.730247:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636749.730250:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7a00, rc 0) 00000100:00100000:2.0:1788636749.730363:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11400:x1875521207079296:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 22784us (23185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636749.730375:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 141 00010000:00010000:0.0:1788636750.235385:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636750.485649:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636750.485691:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226031616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636750.485778:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636750.487211:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226031616 00000100:00100000:2.0:1788636750.487225:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226031616 00000100:00100000:2.0:1788636750.487295:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788636750.487314:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226031616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636750.487356:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636750.487448:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226031616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636750.487455:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788636750.487681:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226031616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636750.490068:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226031872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636750.490132:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636750.490386:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636750.490393:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226031872 00000100:00100000:0.0:1788636750.490398:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226031744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636750.490401:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226031872 00000100:00100000:0.0:1788636750.490430:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636750.490452:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226031744 00000100:00100000:2.0:1788636750.490455:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226031744 00000100:00080000:0.0:1788636750.490476:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636750.490485:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788636750.490494:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521226031872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636750.490526:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636750.490649:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788636750.490659:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226031744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636750.490670:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636750.492349:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226031744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1673us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636750.492367:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788636750.492483:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226031744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636750.492697:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521226031872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2201us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636750.492728:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788636750.492804:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226031872:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788636750.678292:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636750.678303:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636750.678341:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788636750.678349:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636750.678496:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226032000:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788636750.678616:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0084a5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636750.689773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636750.689877:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226032000:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788636750.690070:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207079808 00000100:00100000:3.0:1788636750.690078:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207079808 00000100:00100000:3.0:1788636750.690139:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 142 00000100:00100000:3.0:1788636750.690150:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11411:x1875521207079808:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788636750.690190:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788636750.690324:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11411:x1875521207079808:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 176us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636750.690333:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 142 00000040:00080000:1.0:1788636750.698628:0:14268:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636750.698649:0:14268:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636750.698685:0:14268:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788636750.698693:0:14268:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636750.700492:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636750.700573:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207080064 00000100:00100000:3.0:1788636750.700586:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207080064 00000100:00100000:3.0:1788636750.700655:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 143 00000100:00100000:3.0:1788636750.700667:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:11411:x1875521207080064:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636750.700696:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636750.700724:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838bcb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39181 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636750.700889:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838bd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636750.700912:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636750.700926:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636750.700960:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788636750.701093:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838bcb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39181 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636750.701114:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39181 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636750.701123:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:3.0:1788636750.701127:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636750.701130:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9400, rc 0) 00000100:00100000:3.0:1788636750.701197:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11411:x1875521207080064:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 532us (721us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788636750.701204:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 143 00000100:00100000:3.0:1788636750.706757:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636750.706872:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207080320 00000100:00100000:0.0:1788636750.706888:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207080320 00000100:00100000:0.0:1788636750.706957:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 144 00000100:00100000:0.0:1788636750.706978:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11411:x1875521207080320:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788636750.707064:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838be0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636750.707084:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838be0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636750.707098:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838be0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636750.707295:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838be0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636750.707316:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838be0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636750.707324:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838be0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636750.707331:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636750.707337:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838be0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636750.707347:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838be0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636750.707363:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:0.0:1788636750.707366:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788636750.707372:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838be0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636750.707379:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838be0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636750.707548:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11411:x1875521207080320:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 572us (799us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788636750.707558:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 144 00000040:00080000:1.0:1788636750.707739:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636750.707743:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636750.708282:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788636750.708292:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788636750.718536:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636750.718593:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636750.718629:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207080704 00000100:00100000:2.0:1788636750.718638:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207080704 00000100:00100000:2.0:1788636750.718701:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:2.0:1788636750.718710:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:2398:x1875521207080704:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636750.718726:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636750.718749:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838bd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39181 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636750.718767:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:2.0:1788636750.718773:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636750.718847:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:2398:x1875521207080704:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 138us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636750.718854:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:3.0:1788636750.719461:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207080576 00000100:00100000:3.0:1788636750.719469:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207080576 00000100:00100000:3.0:1788636750.719515:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 34 00000100:00100000:3.0:1788636750.719524:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:11411:x1875521207080576:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788636750.719936:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11411:x1875521207080576:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 412us (1411us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788636750.719945:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 34 00010000:00010000:3.0:1788636751.253768:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636751.526392:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636751.526422:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226032128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636751.526503:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636751.526692:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226032128 00000100:00100000:3.0:1788636751.526701:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226032128 00000100:00100000:3.0:1788636751.526763:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788636751.526775:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226032128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636751.526855:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788636751.526908:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226032128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636751.526916:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788636751.527005:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226032128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636751.999606:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636751.999650:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636751.999672:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636751.999697:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636751.999719:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636751.999737:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636751.999763:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636751.999791:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207081216 00000100:00100000:0.0:1788636751.999801:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207081216 00000100:00100000:0.0:1788636751.999867:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207081344 00000100:00100000:0.0:1788636751.999870:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207081344 00000100:00100000:0.0:1788636751.999887:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 128 00000100:00100000:0.0:1788636751.999896:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207081216:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636751.999966:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207081216:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636751.999973:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 128 00000100:00100000:0.0:1788636751.999990:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 129 00000100:00100000:0.0:1788636751.999996:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207081344:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636752.000019:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207081344:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 23us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636752.000036:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 129 00000100:00100000:0.0:1788636752.000055:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207080960 00000100:00100000:0.0:1788636752.000058:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207080960 00000100:00100000:0.0:1788636752.000085:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207081472 00000100:00100000:0.0:1788636752.000088:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207081472 00000100:00100000:0.0:1788636752.000099:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207081088 00000100:00100000:0.0:1788636752.000102:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207081088 00000100:00100000:0.0:1788636752.000113:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207081600 00000100:00100000:0.0:1788636752.000116:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207081600 00000100:00100000:0.0:1788636752.000265:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 331 00000100:00100000:0.0:1788636752.000274:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:2400:x1875521207080960:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636752.000318:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:2400:x1875521207080960:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 46us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636752.000325:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 331 00000100:00100000:0.0:1788636752.000340:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 332 00000100:00100000:0.0:1788636752.000347:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207081472:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636752.000370:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207081472:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 24us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636752.000376:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 332 00000100:00100000:0.0:1788636752.000387:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 333 00000100:00100000:0.0:1788636752.000393:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207081088:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636752.000417:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207081088:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 24us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636752.000423:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 333 00000100:00100000:0.0:1788636752.000435:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 334 00000100:00100000:0.0:1788636752.000449:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207081600:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636752.000476:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207081600:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 28us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636752.000482:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 334 00000100:00080000:0.0:1788636752.000508:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636752.000512:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636752.000514:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636752.000517:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636752.001959:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207080832 00000100:00100000:2.0:1788636752.001975:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207080832 00000100:00100000:2.0:1788636752.002079:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 392 00000100:00100000:2.0:1788636752.002091:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207080832:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636752.002166:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207080832:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636752.002182:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 392 00000040:00080000:2.0:1788636752.022606:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788636752.280410:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788636752.791537:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636752.791553:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636752.791581:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788636752.791595:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788636753.000546:0:14320:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636753.000561:0:14320:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636753.000597:0:14320:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788636753.000605:0:14320:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636753.047510:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226032256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636753.047617:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636753.048179:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226032256 00000100:00100000:2.0:1788636753.048192:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226032256 00000100:00100000:2.0:1788636753.048277:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788636753.048290:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875521226032256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636753.048350:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788636753.048426:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875521226032256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636753.048434:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788636753.048588:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226032256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636753.048610:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636753.048619:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226032384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636753.048655:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636753.049377:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226032384 00000100:00100000:2.0:1788636753.049387:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226032384 00000100:00100000:2.0:1788636753.049446:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788636753.049458:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226032384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636753.049479:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788636753.049542:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226032384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636753.049549:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788636753.049821:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226032384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636753.049882:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226032768:0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.049922:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636753.049938:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226032896:0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.049947:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226033280:0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.049972:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788636753.049979:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636753.049992:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226033792:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.049992:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226032512:0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.063737:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636753.063890:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226032768 00000100:00100000:3.0:1788636753.063902:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226032768 00000100:00100000:3.0:1788636753.063960:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788636753.063971:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226032768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.071669:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636753.071758:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226032768:12345-0@lo:400:kworker.0 Request processed in 7783us (21829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636753.071777:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788636753.071783:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226032512 00000100:00100000:0.0:1788636753.071796:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226032512 00000100:00100000:3.0:1788636753.071882:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226033280 00000100:00100000:3.0:1788636753.071888:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226033280 00000100:00100000:0.0:1788636753.071911:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788636753.071921:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226032512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.071935:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226033792 00000100:00100000:3.0:1788636753.071938:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226033792 00000100:00100000:3.0:1788636753.071962:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788636753.071968:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226033280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.078143:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226033280:12345-0@lo:400:kworker.0 Request processed in 6159us (28153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636753.078166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788636753.078233:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788636753.078257:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226033792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.078369:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226033792:12345-0@lo:400:kworker.0 Request processed in 127us (14644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636753.078376:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788636753.086537:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226032512:12345-0@lo:400:kworker.0 Request processed in 14597us (14862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636753.086560:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788636753.086671:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226032640:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.086748:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636753.086834:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226033152:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.086872:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636753.086910:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226033664:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.086934:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636753.086986:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226032640 00000100:00100000:0.0:1788636753.086996:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226032640 00000100:00100000:1.0:1788636753.089245:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226032768:0@lo:400:kworker.0 00000100:00100000:1.0:1788636753.089360:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226033152 00000100:00100000:1.0:1788636753.089369:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226033152 00000100:00100000:1.0:1788636753.089435:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226033664 00000100:00100000:1.0:1788636753.089439:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226033664 00000100:00100000:1.0:1788636753.089493:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788636753.089503:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226032640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.089659:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788636753.089672:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226033152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636753.089676:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226032640:12345-0@lo:400:kworker.0 Request processed in 175us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636753.089684:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788636753.089708:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788636753.089712:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226033152:12345-0@lo:400:kworker.0 Request processed in 45us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636753.089714:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226033664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.089719:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788636753.089745:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226033664:12345-0@lo:400:kworker.0 Request processed in 32us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636753.089751:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788636753.089765:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226032640:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.089780:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226033152:0@lo:400:kworker.0 00010000:00080000:1.0:1788636753.089782:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcadf80 x1875521226033280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636753.089790:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032406300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226033664:0@lo:400:kworker.0 00000100:00100000:1.0:1788636753.089794:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226033280:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.089863:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226032512:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.089879:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226033024:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.089928:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636753.089967:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226033024 00000100:00100000:0.0:1788636753.089971:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226033024 00000100:00100000:0.0:1788636753.090002:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788636753.090008:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226033024:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788636753.090013:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03656a00 x1875521226033792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636753.090023:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226033792:0@lo:400:kworker.0 00000100:00080000:3.0:1788636753.093499:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636753.093518:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636753.102688:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636753.102779:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226033408:0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.102900:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636753.102968:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226033408 00000100:00100000:3.0:1788636753.102978:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226033408 00000100:00100000:3.0:1788636753.103081:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788636753.103096:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226033408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.103170:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226033408:12345-0@lo:400:kworker.0 Request processed in 78us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636753.103177:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788636753.103211:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636753.103255:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226033408:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.103964:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226033024:12345-0@lo:400:kworker.0 Request processed in 13938us (14018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636753.103986:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788636753.104064:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226032896 00000100:00100000:0.0:1788636753.104094:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226032896 00000100:00100000:0.0:1788636753.104180:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788636753.104192:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226032896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.104312:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226032896:12345-0@lo:400:kworker.0 Request processed in 123us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636753.104319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788636753.104387:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226033024:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.104400:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226033536:0@lo:400:kworker.0 00000100:00100000:0.0:1788636753.104438:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636753.105189:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226033536 00000100:00100000:2.0:1788636753.105205:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226033536 00000100:00100000:2.0:1788636753.105309:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788636753.105321:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521226033536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636753.105418:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521226033536:12345-0@lo:400:kworker.0 Request processed in 100us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636753.105425:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1788636753.105529:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636753.105605:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226033536:0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.105671:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226032896:0@lo:400:kworker.0 00000100:00100000:3.0:1788636753.186143:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636753.186301:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207081856 00000100:00100000:1.0:1788636753.186319:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207081856 00000100:00100000:1.0:1788636753.186434:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 145 00000100:00100000:1.0:1788636753.186446:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:11433:x1875521207081856:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636753.186478:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636753.186510:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838be7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39188 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.186700:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e838bee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.186735:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e838bee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.186749:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e838bee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636753.186764:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788636753.186957:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838be7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39188 expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.186980:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e838bee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39188 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.186990:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:1.0:1788636753.186993:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788636753.186999:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36200, rc 0) 00000100:00100000:1.0:1788636753.187104:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:11433:x1875521207081856:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 660us (982us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788636753.187112:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 145 00000100:00080000:3.0:1788636753.187700:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636753.195323:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636753.195763:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207081984 00000100:00100000:1.0:1788636753.195987:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207081984 00000100:00100000:1.0:1788636753.196164:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 146 00000100:00100000:1.0:1788636753.196177:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:11433:x1875521207081984:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:1.0:1788636753.196278:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838bfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.196310:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.196345:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.196396:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838bfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.196405:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838bfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.196413:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.196419:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636753.196425:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838bfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.196433:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838bfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.196449:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:1.0:1788636753.196453:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636753.196458:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838bfc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636753.196466:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838bfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636753.196559:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:11433:x1875521207081984:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 384us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636753.196567:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 146 00010000:00010000:2.0:1788636753.318468:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636753.377356:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636753.377503:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207082112 00000100:00100000:2.0:1788636753.377518:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207082112 00000100:00100000:2.0:1788636753.377622:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00100000:2.0:1788636753.377646:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207082112:12345-192.168.202.26@tcp:101:cat.0 00010000:00010000:2.0:1788636753.377672:0:9845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636753.377701:0:9845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6187eb8/0x5b741ef42e838c03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3918f expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636753.377736:0:9845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c6e4c, atime: 0x6a9c6e4c, ctime: 0x6a9c6e4c, blocks: 0x8 00010000:00010000:2.0:1788636753.377766:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=422s v=(0 0) 00010000:00010000:2.0:1788636753.377771:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636753.377783:0:9845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6187eb8/0x5b741ef42e838c03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3918f expref: 7 pid: 9845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636753.377861:0:9845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6187eb8/0x5b741ef42e838c03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3918f expref: 7 pid: 9845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636753.377880:0:9845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0a00, rc 0) 00000100:00100000:2.0:1788636753.377953:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207082112:12345-192.168.202.26@tcp:101:cat.0 Request processed in 321us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636753.377961:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00080000:3.0:1788636753.378407:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636753.392423:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636753.392767:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207082240 00000100:00100000:1.0:1788636753.392786:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207082240 00002000:00100000:1.0:1788636753.392948:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9cef0422a680 x1875521207082240/t0(0) o3->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:239/0 lens 488/0 e 0 to 0 dl 1788636764 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636753.392961:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef0422a680 with x1875521207082240 ext(0->4095) 00002000:00010000:1.0:1788636753.392969:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef0422a680 00000100:00100000:1.0:1788636753.393017:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:1.0:1788636753.393032:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2399:x1875521207082240:12345-192.168.202.26@tcp:3:cat.0 00000100:00100000:1.0:1788636753.393362:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2399:x1875521207082240:12345-192.168.202.26@tcp:3:cat.0 Request processed in 331us (968us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788636753.393371:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 3 00002000:00100000:1.0:1788636753.393379:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9cef0422a680 x1875521207082240/t0(0) o3->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:239/0 lens 488/4536 e 0 to 0 dl 1788636764 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636753.393387:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef0422a680 with x1875521207082240 ext(0->4095) 00002000:00010000:1.0:1788636753.393391:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef0422a680 00010000:00010000:3.0:1788636754.329098:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788636755.102398:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1788636755.102432:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1788636755.103992:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788636755.119359:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788636755.119418:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf00944ec00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788636755.119425:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cef02026f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf00944e180 00000020:00080000:3.0:1788636755.119429:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cef02026900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cef02356000 00000020:00080000:3.0:1788636755.119458:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788636755.119580:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788636755.119691:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788636755.119772:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636755.119786:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636755.119796:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636755.119801:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636755.119846:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636755.119857:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636755.119881:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9cef021a2200) 00010000:00010000:0.0:1788636755.119884:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636755.119903:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636755.119911:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838b7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636755.351232:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636755.605251:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226033920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636755.605388:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636755.605845:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226034048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636755.605887:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636755.605978:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226033920 00000100:00100000:1.0:1788636755.605989:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226033920 00000100:00100000:1.0:1788636755.606081:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788636755.606095:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226033920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636755.606141:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636755.606199:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226033920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636755.606231:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1788636755.606647:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636755.606726:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226034048 00000100:00100000:2.0:1788636755.606733:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226034048 00000100:00100000:2.0:1788636755.606782:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788636755.606799:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226034048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636755.606857:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636755.606921:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226034048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636755.606928:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788636755.607427:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226034048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636755.608926:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226033920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636755.609868:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226034176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636755.609967:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636755.611694:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226034176 00000100:00100000:3.0:1788636755.611711:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226034176 00000100:00100000:3.0:1788636755.611858:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788636755.611871:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226034176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636755.611906:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636755.612018:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226034176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636755.612027:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1788636755.612549:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636755.615130:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788636755.615145:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cef03793800, transno 4294967305 00000100:00100000:2.0:1788636755.615205:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226034176:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788636756.381478:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636756.639617:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636756.648952:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226034304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636756.649074:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636756.653973:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226034304 00000100:00100000:3.0:1788636756.654002:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226034304 00000100:00100000:0.0:1788636756.655601:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788636756.655621:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226034304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636756.656057:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788636756.656326:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226034304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 709us (7250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636756.656337:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788636756.656482:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226034304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636757.139944:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636757.139990:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636757.140009:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207082496 00000100:00100000:0.0:1788636757.140023:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207082496 00000100:00100000:3.0:1788636757.140028:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636757.140061:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636757.140084:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636757.148191:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636757.148245:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636757.154700:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207082368 00000100:00100000:0.0:1788636757.154702:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207083008 00000100:00100000:3.0:1788636757.154723:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207082368 00000100:00100000:0.0:1788636757.154723:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207083008 00000100:00100000:0.0:1788636757.154825:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207082624 00000100:00100000:0.0:1788636757.154830:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207082624 00000100:00100000:0.0:1788636757.154858:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207083136 00000100:00100000:0.0:1788636757.154862:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207083136 00000100:00100000:3.0:1788636757.154894:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 394 00000100:00100000:0.0:1788636757.154899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 341 00000100:00100000:3.0:1788636757.154909:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207082368:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636757.154915:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:2400:x1875521207082496:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636757.155015:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207082368:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 111us (14952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636757.155022:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 394 00000100:00100000:3.0:1788636757.155078:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207082752 00000100:00100000:3.0:1788636757.155083:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207082752 00000100:00100000:3.0:1788636757.155113:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207082880 00000100:00100000:3.0:1788636757.155116:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207082880 00000100:00100000:3.0:1788636757.155138:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 132 00000100:00100000:3.0:1788636757.155144:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207082752:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636757.157799:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 342 00000100:00100000:2.0:1788636757.157851:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207083008:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636757.158071:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:2400:x1875521207082496:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 3159us (18139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636757.158084:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 341 00000100:00100000:0.0:1788636757.158117:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 343 00000100:00100000:0.0:1788636757.158127:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207082624:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636757.158156:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207082624:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 33us (18072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636757.158162:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 343 00000100:00100000:0.0:1788636757.158172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 344 00000100:00100000:0.0:1788636757.158178:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207083136:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636757.158198:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207083136:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 20us (9953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636757.158204:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 344 00000100:00080000:0.0:1788636757.158225:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636757.158233:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636757.158237:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636757.158241:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636757.158917:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 133 00000100:00100000:1.0:1788636757.158933:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207082880:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636757.158976:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207082880:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 50us (10804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636757.158983:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 133 00000100:00100000:3.0:1788636757.165026:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207082752:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 9860us (25013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636757.165053:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 132 00000100:00100000:2.0:1788636757.168167:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207083008:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 10315us (28125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636757.168193:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 342 00010000:00010000:3.0:1788636757.398210:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636758.168190:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0410ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226034816:0@lo:400:kworker.0 00000100:00100000:0.0:1788636758.168305:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636758.168383:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226035328:0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.168429:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf032407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226034432:0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.168518:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636758.168561:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226034944:0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.168594:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636758.168618:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0410a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226035456:0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.168660:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636758.168684:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0410b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226035968:0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.168708:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636758.168827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226034432 00000100:00100000:3.0:1788636758.168837:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226034432 00000100:00100000:3.0:1788636758.168891:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788636758.168901:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521226034432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.168957:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3647:x1875521226034432:12345-0@lo:400:kworker.0 Request processed in 58us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636758.168966:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788636758.169003:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226034944 00000100:00100000:3.0:1788636758.169007:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226034944 00000100:00100000:3.0:1788636758.169029:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788636758.169034:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226034944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.169065:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226034944:12345-0@lo:400:kworker.0 Request processed in 31us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636758.169071:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788636758.169088:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226035456 00000100:00100000:3.0:1788636758.169091:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226035456 00000100:00100000:3.0:1788636758.169124:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226035968 00000100:00100000:3.0:1788636758.169127:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226035968 00000100:00100000:3.0:1788636758.169144:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788636758.169150:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226035456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.169187:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226035456:12345-0@lo:400:kworker.0 Request processed in 37us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636758.169194:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788636758.169203:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788636758.169209:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226035968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.169231:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226035968:12345-0@lo:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636758.169237:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788636758.169328:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf032407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226034432:0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.169342:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226034944:0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.169351:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0410a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226035456:0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.169359:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788636758.169364:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cef03245f80, transno 4294967311 00000004:00080000:3.0:1788636758.169375:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1788636758.169405:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0410b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226035968:0@lo:400:kworker.0 00000100:00100000:0.0:1788636758.169541:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636758.169587:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226035840:0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.169604:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226035328 00000100:00100000:3.0:1788636758.169611:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226035328 00000100:00100000:0.0:1788636758.169633:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636758.169731:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226034688:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.169767:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636758.169791:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226035200:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.169828:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636758.169846:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226035712:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.169884:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636758.169907:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226036224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636758.169931:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636758.169969:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788636758.169976:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0410aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226034560:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.170000:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636758.170017:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226035072:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.170036:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636758.170053:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226035584:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.170075:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636758.170085:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226036096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636758.170105:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636758.170245:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226034688 00000100:00100000:2.0:1788636758.170253:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226034688 00000100:00100000:2.0:1788636758.170311:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788636758.170320:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226034688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.170379:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226034688:12345-0@lo:400:kworker.0 Request processed in 61us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636758.170386:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788636758.170408:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226034816 00000100:00100000:0.0:1788636758.170554:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226035200 00000100:00100000:0.0:1788636758.170566:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226035200 00000100:00100000:0.0:1788636758.170597:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226035712 00000100:00100000:0.0:1788636758.170599:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226035712 00000100:00100000:0.0:1788636758.170612:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226034560 00000100:00100000:0.0:1788636758.170614:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226034560 00000100:00100000:0.0:1788636758.170623:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226035072 00000100:00100000:0.0:1788636758.170624:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226035072 00000100:00100000:0.0:1788636758.170636:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226035584 00000100:00100000:0.0:1788636758.170638:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226035584 00000100:00100000:0.0:1788636758.170650:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788636758.170656:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226035200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636758.170691:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226035200:12345-0@lo:400:kworker.0 Request processed in 35us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636758.170697:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788636758.170709:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788636758.170715:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226035712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636758.170741:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226035712:12345-0@lo:400:kworker.0 Request processed in 27us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636758.170747:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788636758.170757:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788636758.170762:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226034560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636758.170787:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226034560:12345-0@lo:400:kworker.0 Request processed in 25us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636758.170793:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788636758.170802:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788636758.170825:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226035072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636758.170853:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226035072:12345-0@lo:400:kworker.0 Request processed in 46us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636758.170868:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788636758.170879:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788636758.170885:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226035584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636758.170913:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226035584:12345-0@lo:400:kworker.0 Request processed in 29us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636758.170919:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00080000:0.0:1788636758.170935:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636758.170940:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788636758.170942:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636758.170945:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636758.173524:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226034816 00000100:00100000:2.0:1788636758.173643:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788636758.173655:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226034816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.173767:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226034816:12345-0@lo:400:kworker.0 Request processed in 116us (5462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636758.173774:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788636758.173853:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226036224 00000100:00100000:2.0:1788636758.173858:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226036224 00000100:00100000:2.0:1788636758.173889:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226036096 00000100:00100000:2.0:1788636758.173893:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226036096 00000100:00100000:2.0:1788636758.173942:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788636758.173949:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226036224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636758.173989:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788636758.174031:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226036224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (4099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636758.174037:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788636758.174051:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788636758.174056:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226036096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636758.174066:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788636758.174095:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226036096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (3988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636758.174103:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788636758.174179:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0410aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226034560:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.174200:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226035072:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.174214:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0410b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226035584:0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.174672:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226035840 00000100:00100000:3.0:1788636758.174688:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226035840 00000100:00100000:3.0:1788636758.174774:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788636758.174787:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226035328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.174894:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226035328:12345-0@lo:400:kworker.0 Request processed in 110us (5355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636758.174903:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788636758.174924:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788636758.174939:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0410bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226035840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636758.174975:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0410bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226035840:12345-0@lo:400:kworker.0 Request processed in 37us (5343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636758.174982:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1788636758.175386:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636758.176861:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226036096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636758.176884:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226034688:0@lo:400:kworker.0 00010000:00080000:2.0:1788636758.176900:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef04109f80 x1875521226035200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636758.176911:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226035200:0@lo:400:kworker.0 00010000:00080000:2.0:1788636758.176925:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef04108380 x1875521226035712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636758.176934:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226035712:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.176988:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226036224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636758.183797:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0410ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226034816:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.183844:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226035328:0@lo:400:kworker.0 00000100:00100000:2.0:1788636758.183873:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226035840:0@lo:400:kworker.0 00010000:00010000:3.0:1788636758.428952:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636759.112624:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636759.112783:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207083264 00000100:00100000:2.0:1788636759.112797:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207083264 00000100:00100000:2.0:1788636759.112928:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 147 00000100:00100000:2.0:1788636759.112943:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0410b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:11084:x1875521207083264:12345-192.168.202.26@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788636759.113093:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0410b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:11084:x1875521207083264:12345-192.168.202.26@tcp:60:lhsmtool_posix.0 Request processed in 154us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636759.113172:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 147 00000100:00080000:0.0:1788636759.113250:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636759.118615:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636759.118855:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207083392 00000100:00100000:2.0:1788636759.118871:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207083392 00000100:00100000:2.0:1788636759.118965:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 148 00000100:00100000:2.0:1788636759.118980:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:11084:x1875521207083392:12345-192.168.202.26@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1788636759.119200:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636759.119591:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:11084:x1875521207083392:12345-192.168.202.26@tcp:60:lhsmtool_posix.0 Request processed in 613us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636759.119601:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 148 00000100:00100000:3.0:1788636759.136164:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636759.140968:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207083648 00000100:00100000:0.0:1788636759.140993:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207083648 00000100:00100000:1.0:1788636759.144695:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 35 00000100:00100000:1.0:1788636759.144714:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:11084:x1875521207083648:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788636759.145126:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:11084:x1875521207083648:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 415us (9040us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788636759.145137:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 35 00010000:00010000:0.0:1788636759.448341:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636759.570030:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636759.570308:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207083776 00000100:00100000:0.0:1788636759.570325:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207083776 00000100:00100000:0.0:1788636759.570490:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 149 00000100:00100000:0.0:1788636759.570501:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:11892:x1875521207083776:12345-192.168.202.26@tcp:101:lsof.0 00010000:00010000:0.0:1788636759.570528:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636759.570552:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39196 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636759.570637:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636759.570654:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636759.570688:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636759.570753:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788636759.570757:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636759.570864:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636759.570890:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39196 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636759.570906:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39196 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636759.570914:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:0.0:1788636759.570917:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636759.570920:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6000, rc 0) 00000100:00100000:0.0:1788636759.571001:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:11892:x1875521207083776:12345-192.168.202.26@tcp:101:lsof.0 Request processed in 503us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636759.571007:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 149 00000100:00080000:2.0:1788636759.571756:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788636760.475016:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636760.725141:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226036352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636760.725291:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636760.725550:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226036352 00000100:00100000:3.0:1788636760.725563:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226036352 00000100:00100000:3.0:1788636760.725665:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788636760.725683:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226036352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636760.725739:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636760.725799:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226036352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636760.725827:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788636760.725889:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226036352:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788636760.726316:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636760.727100:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226036480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636760.727165:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636760.727286:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226036480 00000100:00100000:1.0:1788636760.727295:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226036480 00000100:00100000:1.0:1788636760.727359:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788636760.727368:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0410a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226036480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636760.727389:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636760.727436:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0410a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226036480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636760.727442:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788636760.727979:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226036480:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788636760.728012:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636760.728448:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226036608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636760.728848:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636760.729174:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226036608 00000100:00100000:3.0:1788636760.729187:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226036608 00000100:00100000:2.0:1788636760.729364:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788636760.729387:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226036608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636760.729433:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636760.729862:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226036608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 422us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636760.729873:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788636760.729954:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226036608:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788636761.254077:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788636761.254111:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788636761.254214:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788636761.254236:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788636761.493098:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636761.750287:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226036736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636761.750401:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636761.753586:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226036736 00000100:00100000:3.0:1788636761.753623:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226036736 00000100:00100000:3.0:1788636761.753798:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788636761.753837:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226036736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636761.753893:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788636761.754038:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226036736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 205us (3637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636761.754062:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788636761.760389:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226036736:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788636762.005207:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636762.005217:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636762.005350:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788636762.005358:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788636762.244056:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636762.244101:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636762.244134:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636762.244158:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636762.244177:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636762.244198:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636762.244223:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636762.244295:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207084160 00000100:00100000:0.0:1788636762.244308:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207084160 00000100:00100000:0.0:1788636762.244403:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207084672 00000100:00100000:0.0:1788636762.244406:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207084672 00000100:00100000:0.0:1788636762.244425:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207084032 00000100:00100000:0.0:1788636762.244427:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207084032 00000100:00100000:0.0:1788636762.244441:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207084544 00000100:00100000:0.0:1788636762.244443:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207084544 00000100:00100000:0.0:1788636762.244461:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 351 00000100:00100000:0.0:1788636762.244475:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0410ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207084160:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636762.244587:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0410ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207084160:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 114us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636762.244597:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 351 00000100:00100000:0.0:1788636762.244619:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 352 00000100:00100000:0.0:1788636762.244626:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207084672:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636762.244673:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207084672:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 46us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636762.244680:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 352 00000100:00100000:0.0:1788636762.244694:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 353 00000100:00100000:0.0:1788636762.244700:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:2400:x1875521207084032:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636762.244732:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:2400:x1875521207084032:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 32us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636762.244739:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 353 00000100:00100000:0.0:1788636762.244750:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 354 00000100:00100000:0.0:1788636762.244757:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207084544:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636762.244783:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207084544:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636762.244789:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 354 00000100:00100000:0.0:1788636762.244838:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207084416 00000100:00100000:0.0:1788636762.244844:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207084416 00000100:00100000:0.0:1788636762.244879:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207084288 00000100:00100000:0.0:1788636762.244881:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207084288 00000100:00100000:3.0:1788636762.244882:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207083904 00000100:00100000:3.0:1788636762.244885:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207083904 00000100:00100000:0.0:1788636762.244903:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 138 00000100:00100000:0.0:1788636762.244909:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207084416:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636762.244917:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 396 00000100:00100000:3.0:1788636762.244923:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207083904:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636762.244938:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207084416:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 30us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636762.244944:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 138 00000100:00100000:3.0:1788636762.244949:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207083904:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 28us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636762.244955:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 139 00000100:00100000:3.0:1788636762.244956:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 396 00000100:00100000:0.0:1788636762.244960:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0410b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207084288:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636762.244992:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0410b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207084288:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 31us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636762.244999:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 139 00000100:00080000:0.0:1788636762.245036:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636762.245040:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636762.245043:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636762.245046:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788636762.261562:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788636762.447727:0:14517:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:32:41 (1788636761) 00010000:00010000:0.0:1788636762.518357:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636763.285458:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226036864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636763.285730:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636763.285889:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226036864 00000100:00100000:0.0:1788636763.285902:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226036864 00000100:00100000:0.0:1788636763.285997:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788636763.286012:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0410aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226036864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636763.286065:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788636763.286137:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0410aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226036864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636763.286146:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1788636763.286179:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636763.286239:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226036864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636763.286275:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636763.286284:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226036992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636763.286315:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636763.286393:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226036992 00000100:00100000:3.0:1788636763.286406:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226036992 00000100:00100000:3.0:1788636763.286486:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788636763.286496:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0410b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226036992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636763.286517:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788636763.286599:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0410b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226036992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636763.286606:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788636763.287145:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226037120:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.287214:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636763.287275:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226037632:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.287303:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636763.287323:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226038144:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.287348:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636763.287376:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788636763.287383:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521226037248:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.287409:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636763.287427:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226037760:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.287445:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636763.287458:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226038272:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.287495:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636763.287773:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226037504:0@lo:400:kworker.0 00000100:00100000:1.0:1788636763.287920:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636763.287965:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226038016:0@lo:400:kworker.0 00000100:00100000:1.0:1788636763.288003:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636763.288038:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788636763.288050:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226037376:0@lo:400:kworker.0 00000100:00100000:2.0:1788636763.288058:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226037120 00000100:00100000:2.0:1788636763.288068:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226037120 00000100:00100000:1.0:1788636763.288106:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636763.288132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788636763.288137:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226037888:0@lo:400:kworker.0 00000100:00100000:2.0:1788636763.288149:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226037120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636763.288187:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636763.288217:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226038400:0@lo:400:kworker.0 00000100:00100000:2.0:1788636763.288242:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226037120:12345-0@lo:400:kworker.0 Request processed in 96us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636763.288263:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788636763.288270:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636763.288316:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226037632 00000100:00100000:2.0:1788636763.288318:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226037376 00000100:00100000:1.0:1788636763.288325:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226037632 00000100:00100000:2.0:1788636763.288328:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226037376 00000100:00100000:2.0:1788636763.288366:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788636763.288413:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226038144 00000100:00100000:3.0:1788636763.288418:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226038144 00000100:00100000:3.0:1788636763.288452:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226038016 00000100:00100000:3.0:1788636763.288456:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226038016 00000100:00100000:3.0:1788636763.288476:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788636763.288482:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226038144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.288524:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226038144:12345-0@lo:400:kworker.0 Request processed in 42us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636763.288530:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788636763.288543:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788636763.288548:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226038016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.288573:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226038016:12345-0@lo:400:kworker.0 Request processed in 27us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636763.288589:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788636763.288639:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226037120:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.288932:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226038144:0@lo:400:kworker.0 00000100:00100000:0.0:1788636763.289075:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226037248 00000100:00100000:2.0:1788636763.289087:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226037376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636763.289093:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226037248 00000100:00100000:0.0:1788636763.289145:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226037760 00000100:00100000:2.0:1788636763.289153:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226037376:12345-0@lo:400:kworker.0 Request processed in 777us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636763.289215:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226038272 00000100:00100000:3.0:1788636763.289220:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226038272 00000100:00100000:3.0:1788636763.289249:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226037504 00000100:00100000:3.0:1788636763.289262:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226037504 00000100:00100000:1.0:1788636763.289280:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788636763.289287:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226037888 00000100:00100000:3.0:1788636763.289294:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226037888 00000100:00100000:1.0:1788636763.289301:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226037632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.289314:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226038400 00000100:00100000:3.0:1788636763.289320:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226038400 00000100:00100000:3.0:1788636763.289340:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788636763.289349:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521226037248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.289419:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032407800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521226037248:12345-0@lo:400:kworker.0 Request processed in 72us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636763.289426:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788636763.289441:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788636763.289448:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226038272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.289476:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226038272:12345-0@lo:400:kworker.0 Request processed in 29us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636763.289482:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788636763.289493:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788636763.289497:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226037504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.289517:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226037504:12345-0@lo:400:kworker.0 Request processed in 20us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636763.289520:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788636763.289534:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788636763.289538:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226037888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.289556:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226037888:12345-0@lo:400:kworker.0 Request processed in 18us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636763.289559:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788636763.289564:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788636763.289567:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226038400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.289582:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226038400:12345-0@lo:400:kworker.0 Request processed in 14us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636763.289585:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788636763.289617:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521226037248:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.289630:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226038272:0@lo:400:kworker.0 00000100:00100000:2.0:1788636763.290079:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:2.0:1788636763.290126:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636763.290131:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636763.290134:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636763.290136:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636763.290175:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226036992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636763.290328:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226037632:12345-0@lo:400:kworker.0 Request processed in 1032us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636763.292709:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226037632:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.292796:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226037376:0@lo:400:kworker.0 00010000:00080000:3.0:1788636763.292834:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef04253b80 x1875521226037888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636763.292846:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226037888:0@lo:400:kworker.0 00010000:00080000:3.0:1788636763.292861:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef04250700 x1875521226038400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636763.292869:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226038400:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.292882:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226037504:0@lo:400:kworker.0 00000100:00100000:3.0:1788636763.292894:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226038016:0@lo:400:kworker.0 00000100:00100000:0.0:1788636763.294655:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226037760 00000100:00100000:0.0:1788636763.294868:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788636763.294883:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226037760:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788636763.295370:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636763.296803:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788636763.298887:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226037760:12345-0@lo:400:kworker.0 Request processed in 3990us (11421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636763.298908:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788636763.299400:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226037760:0@lo:400:kworker.0 00010000:00010000:2.0:1788636763.541749:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636764.200151:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636764.200429:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207084928 00000100:00100000:0.0:1788636764.200444:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207084928 00000100:00100000:0.0:1788636764.200554:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 150 00000100:00100000:0.0:1788636764.200569:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:12159:x1875521207084928:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636764.200603:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636764.200642:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3919d expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.200757:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c1f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.200779:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.200799:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.200879:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.200887:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.200894:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201274:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838c2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201286:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838c2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201294:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838c2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636764.201311:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788636764.201467:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201476:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c1f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201486:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201493:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636764.201499:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201509:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c1f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201526:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cef0331c100) 00010000:00010000:0.0:1788636764.201530:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636764.201538:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201564:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201586:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201593:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c26 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201601:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201607:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636764.201610:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201618:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c26 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201627:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cef021c6100) 00010000:00010000:0.0:1788636764.201631:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636764.201635:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c26 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.201642:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788636764.202457:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788636764.203785:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3919d expref: 16 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.204694:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838c2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3919d expref: 15 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636764.204708:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:0.0:1788636764.204711:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636764.204716:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6400, rc 0) 00000100:00100000:0.0:1788636764.205605:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:12159:x1875521207084928:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 5034us (5465us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788636764.205618:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 150 00000100:00100000:0.0:1788636764.211279:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636764.211401:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636764.211567:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207085184 00000100:00100000:1.0:1788636764.211583:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207085184 00000100:00100000:1.0:1788636764.211685:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:1.0:1788636764.211703:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:2399:x1875521207085184:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636764.211727:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636764.211768:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838c2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3919d expref: 15 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636764.211923:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:1.0:1788636764.211931:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636764.212017:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:2399:x1875521207085184:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 319us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636764.212025:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:3.0:1788636764.212651:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207085056 00000100:00100000:3.0:1788636764.212660:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207085056 00000100:00100000:3.0:1788636764.212709:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 151 00000100:00100000:3.0:1788636764.212718:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0410a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:12159:x1875521207085056:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788636764.212854:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0410a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:12159:x1875521207085056:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 Request processed in 138us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636764.231078:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 151 00000100:00100000:2.0:1788636764.231445:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636764.231581:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207085312 00000100:00100000:0.0:1788636764.231592:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207085312 00000100:00100000:0.0:1788636764.231674:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 152 00000100:00100000:0.0:1788636764.231684:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:12159:x1875521207085312:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788636764.231901:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636764.232028:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:12159:x1875521207085312:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 Request processed in 115us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636764.232039:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 152 00000040:00080000:3.0:1788636764.310573:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788636764.565139:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788636765.078327:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636765.078351:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636765.078926:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1788636765.078939:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788636765.591915:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636765.846915:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636765.846941:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226038528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636765.847469:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226038656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636765.847511:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636765.847586:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226038656 00000100:00100000:3.0:1788636765.847594:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226038656 00000100:00100000:3.0:1788636765.847656:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788636765.847666:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226038656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636765.847694:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636765.847738:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226038656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636765.847745:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788636765.847796:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226038656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788636765.848129:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636765.852649:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636765.852690:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226038784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636765.852776:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636765.855274:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636765.855327:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226038528 00000100:00100000:2.0:1788636765.855336:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226038528 00000100:00100000:2.0:1788636765.855383:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788636765.855394:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226038528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636765.855435:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636765.855501:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226038528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636765.855508:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788636765.855524:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226038784 00000100:00100000:1.0:1788636765.855529:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226038784 00000100:00100000:2.0:1788636765.855568:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226038528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636765.855572:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788636765.855578:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226038784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636765.855592:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636765.855629:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226038784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (2853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636765.855635:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788636765.855658:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226038784:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788636765.855665:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788636766.613860:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636766.705964:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636766.706296:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207085440 00000100:00100000:3.0:1788636766.706307:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207085440 00000100:00080000:1.0:1788636766.706416:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636766.706482:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 153 00000100:00100000:3.0:1788636766.706493:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:12201:x1875521207085440:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636766.706513:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636766.706534:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391a4 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706595:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706608:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706618:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706630:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706637:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706643:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706681:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706687:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706700:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706706:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636766.706710:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706718:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706729:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:3.0:1788636766.706732:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636766.706736:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706743:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706755:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706761:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706766:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706770:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636766.706772:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706788:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706796:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cef0217a500) 00010000:00010000:3.0:1788636766.706799:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636766.706802:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706833:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706869:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391a4 expref: 15 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.706879:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:3.0:1788636766.706881:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636766.706885:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391a4 expref: 15 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.709010:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8800, rc 0) 00000100:00100000:3.0:1788636766.709180:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:12201:x1875521207085440:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 2686us (3220us total) trans 0 rc 301/301 00000100:00100000:3.0:1788636766.709190:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 153 00000100:00100000:3.0:1788636766.728980:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636766.729063:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207085696 00000100:00100000:0.0:1788636766.729074:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207085696 00000100:00100000:0.0:1788636766.729144:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 154 00000100:00100000:0.0:1788636766.729154:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:12201:x1875521207085696:12345-192.168.202.26@tcp:36:lfs.0 00010000:00010000:0.0:1788636766.729224:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636766.729260:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e83858f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fc8 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.729278:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:0.0:1788636766.729284:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636766.729346:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.729368:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39196 expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.729378:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.729412:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39196 expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.729426:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39196 expref: 5 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636766.729441:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04108700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226038912:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636766.729539:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08840 going to sleep for 11 seconds 00000100:00100000:3.0:1788636766.741766:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04108700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226038912:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636766.741800:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636766.743517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636766.744338:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207085824 00000100:00100000:1.0:1788636766.744359:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207085824 00010000:00010000:1.0:1788636766.744432:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39196 expref: 6 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636766.744466:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 80 00000100:00100000:1.0:1788636766.744475:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2401:x1875521207085824:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636766.744489:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636766.744507:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39196 expref: 6 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.744526:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39196 expref: 6 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.744550:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838c11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39196 expref: 6 pid: 6522 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.744564:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:1.0:1788636766.744570:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.744578:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.744585:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.744611:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636766.744664:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207085824:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 190us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636766.744671:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 80 00000100:00080000:3.0:1788636766.746013:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788636766.746152:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.746164:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.746188:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.746212:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.746223:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747173:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747189:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747591:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636766.747622:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcfd33f2 reply state 00000000723bd8cf transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747638:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747646:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:3.0:1788636766.747657:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788636766.747663:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788636766.747671:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788636766.747684:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747691:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747698:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747705:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636766.747710:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747718:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747731:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cef0331c900) 00010000:00010000:3.0:1788636766.747733:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636766.747737:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747744:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c50 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636766.747765:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcfd33f2 reply state 00000000723bd8cf transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747772:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.747787:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cef0217a500) 00010000:00010000:3.0:1788636766.747789:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788636766.747791:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788636766.748190:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:12201:x1875521207085696:12345-192.168.202.26@tcp:36:lfs.0 Request processed in 19031us (19210us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788636766.748211:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 154 00000100:00100000:0.0:1788636766.848128:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636766.848256:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207085952 00000100:00100000:1.0:1788636766.848270:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207085952 00000100:00100000:1.0:1788636766.848359:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 155 00000100:00100000:1.0:1788636766.848380:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:12209:x1875521207085952:12345-192.168.202.26@tcp:101:lctl.0 00010000:00010000:1.0:1788636766.848408:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636766.848436:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838c65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391ab expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.848710:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36000/0x5b741ef42e838c6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.848727:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36000/0x5b741ef42e838c6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.848739:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36000/0x5b741ef42e838c6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636766.848795:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788636766.848798:0:11089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788636766.848878:0:11089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36000/0x5b741ef42e838c6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.848912:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838c65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ab expref: 17 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.848935:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36000/0x5b741ef42e838c6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ab expref: 16 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636766.848945:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf015d06300) 00010000:00010000:1.0:1788636766.848949:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636766.848954:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36000, rc 0) 00000100:00100000:1.0:1788636766.850385:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:12209:x1875521207085952:12345-192.168.202.26@tcp:101:lctl.0 Request processed in 1993us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636766.850401:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 155 00000100:00100000:1.0:1788636766.875305:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636766.875339:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226039040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636766.875447:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636766.875595:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226039040 00000100:00100000:0.0:1788636766.875611:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226039040 00000100:00100000:0.0:1788636766.875672:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788636766.875682:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226039040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636766.875719:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788636766.875782:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04086300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226039040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636766.875789:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788636766.876092:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226039040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636766.934717:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636766.934871:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207086080 00000100:00100000:0.0:1788636766.934881:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207086080 00000100:00100000:0.0:1788636766.934935:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 156 00000100:00100000:0.0:1788636766.934943:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:12215:x1875521207086080:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:0.0:1788636766.934963:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636766.934984:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391b2 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935060:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935071:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935080:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935087:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838c81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935091:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838c81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935112:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838c81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935186:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935190:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935194:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636766.935221:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788636766.935224:0:13298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636766.935255:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935268:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935275:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935281:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935287:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636766.935292:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935300:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935324:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf015d06300) 00010000:00010000:0.0:1788636766.935327:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636766.935332:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935517:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838c7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935535:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838c81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935542:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838c81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935549:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838c81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935555:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636766.935558:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838c81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935564:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838c81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935573:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cef0217a500) 00010000:00010000:0.0:1788636766.935576:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636766.935579:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838c81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935584:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838c81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935622:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838c73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b2 expref: 18 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935634:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b2 expref: 17 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.935642:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:0.0:1788636766.935644:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788636766.935647:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6200, rc 0) 00000100:00100000:0.0:1788636766.935763:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:12215:x1875521207086080:12345-192.168.202.26@tcp:101:bash.0 Request processed in 819us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636766.935771:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 156 00000100:00100000:2.0:1788636766.941857:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636766.941995:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207086336 00000100:00100000:3.0:1788636766.942005:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207086336 00000100:00100000:3.0:1788636766.942087:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 157 00000100:00100000:3.0:1788636766.942100:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:12215:x1875521207086336:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636766.942127:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636766.942156:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c8f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391b9 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.942312:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838c96 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.942329:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838c96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.942718:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838c96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.944760:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.944786:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.944834:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788636766.945275:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788636766.945505:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945517:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945526:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945568:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838c96 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945576:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838c96 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945582:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838c96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945587:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636766.945592:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838c96 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945599:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838c96 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945612:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:3.0:1788636766.945615:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636766.945629:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838c96 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945635:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838c96 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636766.945652:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000428cc91a reply state 00000000408e4e71 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945664:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945670:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217a800) 00010000:00010000:3.0:1788636766.945673:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788636766.945676:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788636766.945721:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838c8f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b9 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945739:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b9 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.945747:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a700) 00010000:00010000:3.0:1788636766.945749:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636766.945751:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8200, rc 0) 00000100:00100000:3.0:1788636766.946378:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:12215:x1875521207086336:12345-192.168.202.26@tcp:101:bash.0 Request processed in 4275us (4525us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788636766.946388:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 157 00000100:00100000:2.0:1788636766.951100:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636766.951199:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207086464 00000100:00100000:0.0:1788636766.951210:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207086464 00000100:00100000:0.0:1788636766.951445:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00100000:0.0:1788636766.951459:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207086464:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:0.0:1788636766.951487:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636766.951517:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838cb2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391c0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788636766.951548:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788636766.951576:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788636766.951581:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636766.951593:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c0 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.951646:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c0 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.951662:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7600, rc 0) 00000100:00100000:0.0:1788636766.951785:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207086464:12345-192.168.202.26@tcp:101:bash.0 Request processed in 329us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636766.951792:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00080000:3.0:1788636766.951956:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636766.955723:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636766.955840:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207086592 00000100:00100000:2.0:1788636766.955851:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207086592 00000100:00100000:2.0:1788636766.955934:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 56 00000100:00100000:2.0:1788636766.955945:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:12215:x1875521207086592:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636766.955967:0:9847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636766.956065:0:9847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391c7 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636766.956102:0:9847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838cb2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c0 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636766.956130:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636766.956136:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636766.956141:0:9847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 7 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636766.956180:0:9847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838cb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c0 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636766.956195:0:9847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838cb2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c0 expref: 7 pid: 8438 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636766.956211:0:9847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04253b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9847:1875521226039168:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636766.956470:0:9847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636766.960148:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636766.960491:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207086720 00000100:00100000:3.0:1788636766.960501:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207086720 00010000:00010000:3.0:1788636766.960542:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838cb2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c0 expref: 8 pid: 8438 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636766.960600:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 81 00000100:00100000:3.0:1788636766.960610:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2400:x1875521207086720:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636766.960625:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636766.960646:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838cb2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c0 expref: 8 pid: 8438 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.960660:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838cb2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c0 expref: 8 pid: 8438 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.960683:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636766.960688:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636766.960697:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 8 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.960706:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 8 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636766.960741:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 8 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636766.960755:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1875521226039296:192.168.202.26@tcp:105: 00000100:00100000:3.0:1788636766.960849:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636766.963366:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1875521226039296:192.168.202.26@tcp:105: 00010000:00010000:3.0:1788636766.963409:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636766.963463:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2400:x1875521207086720:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 2854us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636766.963474:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 81 00010000:00010000:0.0:1788636766.965048:0:9847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838cb2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c0 expref: 7 pid: 8438 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636766.965072:0:9847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04253b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9847:1875521226039168:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636766.965113:0:9847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 6 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636766.965131:0:9847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1e00, rc 0) 00000100:00100000:0.0:1788636766.965215:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:12215:x1875521207086592:12345-192.168.202.26@tcp:101:bash.0 Request processed in 9270us (9501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636766.965224:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 56 00000100:00100000:1.0:1788636766.968493:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636766.968890:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207086976 00000100:00100000:3.0:1788636766.968902:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207086976 00000100:00100000:3.0:1788636766.968980:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 36 00000100:00100000:3.0:1788636766.968991:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:12215:x1875521207086976:12345-192.168.202.26@tcp:35:bash.0 00000100:00100000:3.0:1788636766.969381:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04084e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:12215:x1875521207086976:12345-192.168.202.26@tcp:35:bash.0 Request processed in 390us (903us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788636766.969388:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 36 00000100:00100000:1.0:1788636767.076233:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636767.076373:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207087232 00000100:00100000:2.0:1788636767.076386:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207087232 00000100:00100000:2.0:1788636767.076469:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 158 00000100:00100000:2.0:1788636767.076481:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:12225:x1875521207087232:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636767.076507:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636767.076532:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838cc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391ce expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636767.076664:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788636767.076799:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838cc0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ce expref: 23 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.076872:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf015d06300) 00010000:00010000:2.0:1788636767.076875:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636767.076881:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838cc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ce expref: 23 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.076895:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1000, rc 0) 00000100:00100000:2.0:1788636767.076951:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:12225:x1875521207087232:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 472us (730us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788636767.076958:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 158 00000001:00080000:2.0:1788636767.080918:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967421 is committed 00010000:00010000:3.0:1788636767.081322:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081395:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081405:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081411:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636767.081416:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081424:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081444:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cef0217a500) 00010000:00010000:3.0:1788636767.081448:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636767.081476:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081484:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838c57 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081509:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081514:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081519:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081524:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636767.081527:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081533:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081540:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:3.0:1788636767.081543:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636767.081546:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081551:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838c5e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081567:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081572:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081583:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081589:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636767.081591:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081597:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081605:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217a800) 00010000:00010000:3.0:1788636767.081607:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636767.081610:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.081616:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838c9d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636767.089901:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636767.090098:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207087488 00000100:00100000:3.0:1788636767.090111:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207087488 00000100:00100000:3.0:1788636767.090179:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 37 00000100:00100000:3.0:1788636767.090191:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+15:12225:x1875521207087488:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636767.090722:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:12225:x1875521207087488:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 531us (830us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788636767.090731:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 37 00000100:00100000:3.0:1788636767.228180:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636767.228721:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207087616 00000100:00100000:0.0:1788636767.228732:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207087616 00000100:00100000:0.0:1788636767.228802:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 159 00000100:00100000:0.0:1788636767.228844:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+16:12231:x1875521207087616:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636767.228878:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636767.228898:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838cce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391d5 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.228965:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838cd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.228995:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.229011:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636767.229058:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788636767.229061:0:13298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636767.229082:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.229109:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838cce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391d5 expref: 18 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.229138:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391d5 expref: 17 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.229147:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:0.0:1788636767.229151:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636767.229155:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6400, rc 0) 00000100:00100000:0.0:1788636767.229733:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:12231:x1875521207087616:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 494us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636767.229744:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 159 00000100:00100000:1.0:1788636767.249257:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636767.249612:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207087872 00000100:00100000:3.0:1788636767.249625:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207087872 00000100:00100000:3.0:1788636767.249701:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 160 00000100:00100000:3.0:1788636767.249722:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+17:12231:x1875521207087872:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636767.249743:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636767.249765:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838cdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391dc expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.249935:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838ce3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.249953:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.249967:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636767.250613:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788636767.250764:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838cdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391dc expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.250784:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391dc expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.250795:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a700) 00010000:00010000:3.0:1788636767.250798:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636767.250802:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9000, rc 0) 00000100:00100000:3.0:1788636767.251145:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:12231:x1875521207087872:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1433us (1909us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788636767.251154:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 160 00000100:00100000:2.0:1788636767.260294:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636767.260361:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636767.260648:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207088256 00000100:00100000:0.0:1788636767.260661:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207088256 00000100:00100000:0.0:1788636767.260739:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:0.0:1788636767.260751:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04250380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:2399:x1875521207088256:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636767.260768:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636767.260798:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838ce3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391dc expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.260853:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a700) 00010000:00010000:0.0:1788636767.260859:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636767.260930:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04250380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2399:x1875521207088256:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 181us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636767.260939:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:1.0:1788636767.261463:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207088128 00000100:00100000:1.0:1788636767.261470:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207088128 00000100:00100000:1.0:1788636767.261599:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 161 00000100:00100000:1.0:1788636767.261609:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:12231:x1875521207088128:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636767.261631:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636767.261648:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838cf1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391e3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.261763:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838cf8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.261781:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.261793:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838cf8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636767.261836:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788636767.261969:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838cf1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391e3 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.261985:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391e3 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.262012:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a700) 00010000:00010000:1.0:1788636767.262015:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788636767.262019:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37400, rc 0) 00000100:00100000:1.0:1788636767.262065:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:12231:x1875521207088128:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 458us (1788us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788636767.262072:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 161 00000100:00100000:2.0:1788636767.272111:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636767.277636:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207088384 00000100:00100000:0.0:1788636767.277653:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207088384 00000100:00100000:0.0:1788636767.277744:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:0.0:1788636767.277754:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207088384:12345-192.168.202.26@tcp:1:lfs.0 00010000:00010000:0.0:1788636767.277802:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.277838:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 6 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.277848:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788636767.277852:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636767.277857:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.277919:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 6 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.277937:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 6 pid: 9847 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636767.277954:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875521226039424:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636767.278069:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788636767.282066:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03724000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875521226039424:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636767.282111:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636767.288982:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.289088:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207088512 00000100:00100000:1.0:1788636767.289100:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207088512 00002000:00100000:1.0:1788636767.289181:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9cef04253100 x1875521207088512/t0(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:253/0 lens 504/0 e 0 to 0 dl 1788636778 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636767.289193:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef04253100 with x1875521207088512 ext(0->12) 00010000:00010000:1.0:1788636767.289205:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 7 pid: 9847 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.289224:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 7 pid: 9847 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636767.289231:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cef04253100 00000100:00100000:1.0:1788636767.289276:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 2 00000100:00100000:1.0:1788636767.289285:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207088512:12345-192.168.202.26@tcp:4:lfs.0 00000100:00100000:1.0:1788636767.291397:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2400:x1875521207088512:12345-192.168.202.26@tcp:4:lfs.0 Request processed in 2099us (2413us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788636767.291413:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 2 00002000:00100000:1.0:1788636767.291426:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9cef04253100 x1875521207088512/t4294967306(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:253/0 lens 504/448 e 0 to 0 dl 1788636778 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636767.291459:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef04253100 with x1875521207088512 ext(0->12) 00010000:00010000:1.0:1788636767.291475:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 9 pid: 9847 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.291507:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 9 pid: 9847 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636767.291516:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cef04253100 00000100:00100000:3.0:1788636767.305942:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636767.306202:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207088640 00000100:00100000:0.0:1788636767.306216:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207088640 00010000:00010000:0.0:1788636767.306274:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 9 pid: 9847 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636767.306323:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 82 00000100:00100000:0.0:1788636767.306333:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2399:x1875521207088640:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636767.306359:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788636767.306378:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788636767.306381:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788636767 00002000:00010000:0.0:1788636767.306383:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788636767 00002000:00010000:0.0:1788636767.306386:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788636767 00002000:00010000:0.0:1788636767.306396:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788636767.306403:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 9 pid: 9847 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.306417:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 9 pid: 9847 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.306443:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccc66970/0x5b741ef42e838cb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391c7 expref: 9 pid: 9847 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.306462:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636767.306467:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636767.306473:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.306483:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.306655:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636767.306906:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2399:x1875521207088640:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 572us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636767.306915:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 82 00010000:00010000:2.0:1788636767.307011:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.307023:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.307045:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.307055:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.307073:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.307080:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636767.307084:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.307094:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.307120:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.307129:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e838d06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636767.307187:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207088384:12345-192.168.202.26@tcp:1:lfs.0 Request processed in 29435us (35091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636767.307195:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:2.0:1788636767.313562:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.313707:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207088896 00000100:00100000:1.0:1788636767.313721:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207088896 00000100:00100000:1.0:1788636767.313797:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 38 00000100:00100000:1.0:1788636767.313836:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:12231:x1875521207088896:12345-192.168.202.26@tcp:35:lfs.0 00000004:00010000:1.0:1788636767.313896:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838cf8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391e3 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636767.314107:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788636767.314152:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788636767.314903:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788636767.314958:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.314979:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b9 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.314989:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.315055:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b9 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.315071:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b9 expref: 24 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636767.315090:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1875521226039552:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636767.315199:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033840 going to sleep for 11 seconds 00000100:00100000:3.0:1788636767.321483:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1875521226039552:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636767.321542:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636767.325951:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.326454:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207089024 00000100:00100000:1.0:1788636767.326465:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207089024 00010000:00010000:1.0:1788636767.326531:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b9 expref: 25 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636767.326577:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 83 00000100:00100000:1.0:1788636767.326589:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04253b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:2400:x1875521207089024:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636767.326604:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636767.326612:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b9 expref: 25 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.326626:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b9 expref: 25 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.326648:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838ca4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b9 expref: 25 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.326664:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a700) 00010000:00010000:1.0:1788636767.326684:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.326694:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.326701:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.326735:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636767.326794:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04253b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:2400:x1875521207089024:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 208us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636767.326802:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 83 00010000:00010000:3.0:1788636767.327000:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.327010:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636767.327185:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1788636767.327369:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788636767.327473:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012919500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1875521226039680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788636767.327738:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636767.327785:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788636767.328683:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226039680 00000100:00100000:1.0:1788636767.328695:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226039680 00000100:00100000:1.0:1788636767.328772:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788636767.328784:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875521226039680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788636767.328900:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1875521226039680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 118us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636767.328906:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1788636767.330104:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636767.330175:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012919500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1875521226039680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788636767.330429:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788636767.330668:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012919500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1875521226039808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788636767.330741:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636767.330897:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636767.339753:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226039808 00000100:00100000:0.0:1788636767.339773:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226039808 00000100:00100000:0.0:1788636767.339868:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788636767.339878:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1875521226039808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788636767.340138:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1875521226039808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 261us (9396us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788636767.340172:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788636767.340594:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012919500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1875521226039808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788636767.340696:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788636767.340755:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.340766:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.340786:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.340793:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636767.340798:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.340837:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.340853:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a700) 00010000:00010000:3.0:1788636767.340857:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788636767.340862:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.340869:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e838d0d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788636767.341250:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788636767.341362:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788636767.341377:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 436152569992ns, next at 437152567034ns, rc = 0 00000001:00080000:3.0:1788636767.341386:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788636767.341417:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a700) 00010000:00010000:3.0:1788636767.341420:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788636767.341429:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e838cf8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391e3 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636767.341718:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:12231:x1875521207088896:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 27910us (28171us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788636767.341742:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 38 00000020:00080000:3.0:1788636767.341747:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788636767.350177:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.350300:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207089152 00000100:00100000:1.0:1788636767.350313:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207089152 00000100:00100000:1.0:1788636767.350611:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 162 00000100:00100000:1.0:1788636767.350623:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:12231:x1875521207089152:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636767.350648:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636767.350673:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e838d14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391ea expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.350739:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e838d14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ea expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.350775:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e838d14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ea expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.350797:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:1.0:1788636767.350801:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636767.351303:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36800, rc 0) 00000100:00100000:1.0:1788636767.351405:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+28:12231:x1875521207089152:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 784us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636767.354557:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 162 00000100:00100000:1.0:1788636767.359126:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.359163:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.359202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.359231:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207089536 00000100:00100000:1.0:1788636767.359252:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207089536 00000100:00100000:1.0:1788636767.359318:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 398 00000100:00100000:1.0:1788636767.359330:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207089536:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636767.359433:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207089664 00000100:00100000:0.0:1788636767.359438:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207089664 00000100:00100000:0.0:1788636767.359480:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207089920 00000100:00100000:0.0:1788636767.359483:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207089920 00000100:00100000:0.0:1788636767.359519:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 361 00000100:00100000:0.0:1788636767.359527:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207089664:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636767.359625:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207089664:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 99us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636767.359633:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 361 00000100:00100000:0.0:1788636767.359649:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 362 00000100:00100000:0.0:1788636767.359655:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207089920:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636767.359682:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207089920:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 27us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636767.359688:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 362 00000100:00080000:0.0:1788636767.359703:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636767.359852:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207089536:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 524us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636767.359860:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 398 00000100:00100000:1.0:1788636767.359906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.359978:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.359995:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207090048 00000100:00100000:1.0:1788636767.359998:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207090048 00000100:00100000:1.0:1788636767.360022:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 363 00000100:00100000:1.0:1788636767.360027:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207090048:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636767.360067:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207090048:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 40us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636767.360074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 363 00000100:00100000:1.0:1788636767.360597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.360625:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207089408 00000100:00100000:1.0:1788636767.360630:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207089408 00000100:00100000:1.0:1788636767.360663:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 39 00000100:00100000:1.0:1788636767.360669:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+28:12231:x1875521207089408:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:1.0:1788636767.360951:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:12231:x1875521207089408:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 281us (354us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788636767.360958:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 39 00000100:00100000:0.0:1788636767.361520:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207089792 00000100:00100000:0.0:1788636767.361529:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207089792 00000100:00100000:0.0:1788636767.361590:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 142 00000100:00100000:0.0:1788636767.361598:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207089792:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636767.361637:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207089792:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 41us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636767.361644:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 142 00000100:00080000:0.0:1788636767.361664:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636767.361670:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636767.475332:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636767.475522:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207090304 00000100:00100000:2.0:1788636767.475536:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207090304 00000100:00100000:2.0:1788636767.475606:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 163 00000100:00100000:2.0:1788636767.475637:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:12241:x1875521207090304:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636767.475671:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636767.475697:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391f1 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636767.475860:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788636767.475978:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838d1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f1 expref: 31 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.475997:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf015d06300) 00010000:00010000:2.0:1788636767.476000:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636767.476008:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f1 expref: 31 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636767.476027:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0400, rc 0) 00000100:00100000:2.0:1788636767.476107:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:12241:x1875521207090304:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 473us (788us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788636767.476115:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 163 00000100:00100000:2.0:1788636767.480999:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636767.481219:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207090432 00000100:00100000:1.0:1788636767.481233:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207090432 00000100:00100000:1.0:1788636767.481774:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 164 00000100:00100000:1.0:1788636767.481784:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:12241:x1875521207090432:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:1.0:1788636767.481915:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d29 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.481937:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.481952:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.481968:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482126:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482153:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482279:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482288:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482295:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636767.482415:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482431:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482437:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d29 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482444:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482449:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636767.482453:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482461:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d29 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482477:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:1.0:1788636767.482488:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636767.482576:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482583:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482599:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482604:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482610:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482615:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636767.482617:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482623:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482630:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cf015d06000) 00010000:00010000:1.0:1788636767.482633:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636767.482636:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482641:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482656:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482669:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482675:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482680:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636767.482683:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482689:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482698:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:1.0:1788636767.482700:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636767.482703:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636767.482709:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e838d37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636767.482919:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:12241:x1875521207090432:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 1133us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636767.482929:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 164 00000100:00100000:1.0:1788636767.486472:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636767.486662:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207090688 00000100:00100000:3.0:1788636767.486671:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207090688 00000100:00100000:3.0:1788636767.486771:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 40 00000100:00100000:3.0:1788636767.486782:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:12241:x1875521207090688:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636767.487117:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+31:12241:x1875521207090688:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 335us (657us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788636767.487126:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 40 00000100:00100000:2.0:1788636767.594954:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636767.595095:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207090944 00000100:00100000:3.0:1788636767.595110:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207090944 00000100:00100000:3.0:1788636767.595214:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 165 00000100:00100000:3.0:1788636767.595226:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+31:12244:x1875521207090944:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636767.595297:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636767.595332:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838d3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391f8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.595448:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d45 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.595464:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.595475:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.595490:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.595516:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.595522:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.595645:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.595653:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.595660:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636767.595670:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788636767.596536:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596547:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d45 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596555:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596562:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636767.596567:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596576:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d45 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596611:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:3.0:1788636767.596614:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636767.596621:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596628:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596646:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596653:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596660:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596666:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636767.596669:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.596676:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.598870:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217a700) 00010000:00010000:3.0:1788636767.598888:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636767.598909:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636767.598927:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.600420:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838d3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f8 expref: 34 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.600455:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f8 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.600466:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:0.0:1788636767.600469:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636767.600473:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9600, rc 0) 00000100:00100000:0.0:1788636767.600576:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+33:12244:x1875521207090944:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 5351us (5638us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788636767.600586:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 165 00000100:00100000:2.0:1788636767.609613:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636767.609846:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207091072 00000100:00100000:0.0:1788636767.609857:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207091072 00000100:00100000:0.0:1788636767.609925:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 166 00000100:00100000:0.0:1788636767.609935:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+33:12244:x1875521207091072:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:0.0:1788636767.610030:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.610048:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.610062:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.610113:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.610121:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.611848:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.611854:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636767.611859:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.611869:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.611886:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:0.0:1788636767.611890:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636767.611895:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636767.611902:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636767.620674:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+33:12244:x1875521207091072:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 10718us (11051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636767.620701:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 166 00000100:00100000:3.0:1788636767.630571:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636767.630665:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207091328 00000100:00100000:0.0:1788636767.630675:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207091328 00000100:00100000:0.0:1788636767.630750:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 41 00000100:00100000:0.0:1788636767.630763:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+33:12244:x1875521207091328:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:0.0:1788636767.631133:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+34:12244:x1875521207091328:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 371us (579us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788636767.631143:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 41 00010000:00010000:3.0:1788636767.637602:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636768.087413:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636768.087481:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207091584 00000100:00100000:1.0:1788636768.087555:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207091584 00000100:00100000:1.0:1788636768.087684:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 167 00000100:00080000:0.0:1788636768.087687:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636768.087696:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+34:12276:x1875521207091584:12345-192.168.202.26@tcp:101:cat.0 00010000:00010000:1.0:1788636768.087739:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636768.087762:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef391ff expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636768.087921:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636768.087936:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636768.087949:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636768.087961:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788636768.088096:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838d68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ff expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636768.088116:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ff expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636768.088127:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:1.0:1788636768.088130:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636768.088134:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36e00, rc 0) 00000100:00100000:1.0:1788636768.088195:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:12276:x1875521207091584:12345-192.168.202.26@tcp:101:cat.0 Request processed in 502us (795us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788636768.088203:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 167 00000100:00100000:3.0:1788636768.092849:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636768.092895:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636768.093753:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207091968 00000100:00100000:0.0:1788636768.093785:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207091968 00000100:00100000:1.0:1788636768.093901:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207091840 00000100:00100000:1.0:1788636768.093906:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207091840 00000100:00100000:0.0:1788636768.093908:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:0.0:1788636768.093921:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:2398:x1875521207091968:12345-192.168.202.26@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788636768.093936:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 42 00010000:00010000:0.0:1788636768.093949:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788636768.093952:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:12276:x1875521207091840:12345-192.168.202.26@tcp:35:cat.0 00010000:00010000:0.0:1788636768.093984:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e838d6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ff expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.094007:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:0.0:1788636768.094014:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636768.094070:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:2398:x1875521207091968:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 152us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636768.094078:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:1.0:1788636768.095529:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:12276:x1875521207091840:12345-192.168.202.26@tcp:35:cat.0 Request processed in 1570us (2728us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788636768.095540:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 42 00000100:00100000:3.0:1788636768.189847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636768.189970:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207092224 00000100:00100000:0.0:1788636768.189981:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207092224 00000100:00100000:0.0:1788636768.190047:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 168 00000100:00100000:0.0:1788636768.190068:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:12282:x1875521207092224:12345-192.168.202.26@tcp:101:dd.0 00010000:00010000:0.0:1788636768.190096:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636768.190099:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788636768.190126:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838cd5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391d5 expref: 36 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.190145:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:0.0:1788636768.190150:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636768.190163:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d7d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39206 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.190304:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.190331:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f8 expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.190350:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.190384:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f8 expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.190398:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f8 expref: 36 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636768.190411:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04108e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226039936:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636768.190650:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788636768.198022:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04108e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226039936:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636768.198054:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636768.204647:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.205220:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207092352 00000100:00100000:2.0:1788636768.205245:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207092352 00010000:00010000:2.0:1788636768.205586:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f8 expref: 37 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636768.205680:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 84 00000100:00100000:2.0:1788636768.205691:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:2401:x1875521207092352:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636768.205706:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636768.205714:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f8 expref: 37 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.205729:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f8 expref: 37 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.205753:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838d53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391f8 expref: 37 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.205773:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636768.205779:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.205789:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.205796:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.205852:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636768.205917:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:2401:x1875521207092352:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 228us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.205925:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 84 00010000:00010000:0.0:1788636768.205999:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.206008:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636768.206028:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788636768.206189:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838d7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39206 expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.206222:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39206 expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.206230:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:0.0:1788636768.206245:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788636768.206248:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6000, rc 0) 00000100:00100000:0.0:1788636768.206285:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:12282:x1875521207092224:12345-192.168.202.26@tcp:101:dd.0 Request processed in 16229us (16477us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788636768.206292:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 168 00000100:00100000:0.0:1788636768.210594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636768.211113:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207092480 00000100:00100000:3.0:1788636768.211129:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207092480 00000100:00100000:3.0:1788636768.211476:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 169 00000100:00100000:3.0:1788636768.211652:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+36:12282:x1875521207092480:12345-192.168.202.26@tcp:101:dd.0 00010000:00010000:3.0:1788636768.211690:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636768.211716:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3920d expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.211756:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.211770:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.211781:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.212270:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838d92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3920d expref: 38 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.212295:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3920d expref: 37 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.212313:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:3.0:1788636768.212316:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636768.212321:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8000, rc 0) 00000100:00100000:3.0:1788636768.214603:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:12282:x1875521207092480:12345-192.168.202.26@tcp:101:dd.0 Request processed in 3105us (4011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636768.214616:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 169 00000100:00100000:1.0:1788636768.224240:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.224443:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207092736 00000100:00100000:2.0:1788636768.224469:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207092736 00000100:00100000:2.0:1788636768.224545:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 170 00000100:00100000:2.0:1788636768.224556:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:12282:x1875521207092736:12345-192.168.202.26@tcp:36:dd.0 00010000:00010000:2.0:1788636768.224840:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.224859:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.224871:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788636768.224912:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1788636768.224935:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002642983 reply state 00000000d2fc02ee transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.224949:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.224956:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636768.224959:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636768.224963:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636768.225086:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+40:12282:x1875521207092736:12345-192.168.202.26@tcp:36:dd.0 Request processed in 530us (862us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788636768.225094:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 170 00000020:00080000:2.0:1788636768.225099:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788636768.405068:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788636768.405105:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226040576:0@lo:400:kworker.0 00000100:00100000:0.0:1788636768.405160:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521226040320:0@lo:400:kworker.0 00000100:00100000:0.0:1788636768.405282:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636768.405357:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226040832:0@lo:400:kworker.0 00000100:00100000:0.0:1788636768.405391:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636768.405414:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226041344:0@lo:400:kworker.0 00000100:00100000:0.0:1788636768.405436:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636768.405458:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788636768.405463:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226040448:0@lo:400:kworker.0 00000100:00100000:0.0:1788636768.405488:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636768.405505:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226040960:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.405516:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636768.405536:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226040448 00000100:00100000:2.0:1788636768.405539:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226041088:0@lo:400:kworker.0 00000100:00100000:0.0:1788636768.405545:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226040448 00000100:00100000:2.0:1788636768.405588:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636768.405605:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226040192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636768.405605:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788636768.405613:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226040448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.405626:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636768.405641:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226040064:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.405665:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636768.405669:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226040448:12345-0@lo:400:kworker.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636768.405678:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788636768.405684:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226041600:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.405703:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636768.405703:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636768.405718:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788636768.405719:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521226041472:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.405723:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226040704:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.405739:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636768.405739:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636768.405750:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226041216:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.405768:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636768.405771:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226040448:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.405782:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226041728:0@lo:400:kworker.0 00000100:00100000:0.0:1788636768.405796:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226041088 00000100:00100000:2.0:1788636768.405800:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636768.405800:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226041088 00000100:00100000:2.0:1788636768.405849:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226041600 00000100:00100000:2.0:1788636768.405853:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226041600 00000100:00100000:0.0:1788636768.405858:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226041216 00000100:00100000:0.0:1788636768.405861:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226041216 00000100:00100000:2.0:1788636768.405869:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226041728 00000100:00100000:2.0:1788636768.405871:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226041728 00000100:00100000:0.0:1788636768.405872:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788636768.405877:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226041088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.405882:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788636768.405887:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226041600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636768.405911:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226041088:12345-0@lo:400:kworker.0 Request processed in 33us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.405912:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03246a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226041600:12345-0@lo:400:kworker.0 Request processed in 25us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636768.405917:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788636768.406113:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636768.406123:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226041856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636768.406391:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636768.406423:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226040192 00000100:00100000:3.0:1788636768.406427:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226040192 00000100:00100000:3.0:1788636768.406454:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226041856 00000100:00100000:3.0:1788636768.406457:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226041856 00000100:00100000:3.0:1788636768.406476:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788636768.406540:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875521226040192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788636768.406568:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788636768.406607:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875521226040192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636768.406613:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788636768.406628:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788636768.406634:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226041856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636768.406642:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788636768.406667:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226041856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636768.406672:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788636768.406701:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226040064 00000100:00100000:3.0:1788636768.406705:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226040064 00000100:00100000:3.0:1788636768.406729:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788636768.406735:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521226040064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636768.406764:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521226040064:12345-0@lo:400:kworker.0 Request processed in 30us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636768.406770:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788636768.406793:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226040704 00000100:00100000:3.0:1788636768.406796:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226040704 00000100:00100000:3.0:1788636768.406854:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788636768.406861:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226040704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636768.406889:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226040704:12345-0@lo:400:kworker.0 Request processed in 29us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636768.406894:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788636768.406943:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226041856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636768.407064:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788636768.407084:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788636768.407092:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226041216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407146:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226041216:12345-0@lo:400:kworker.0 Request processed in 55us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.407152:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788636768.407173:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788636768.407179:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226041728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407203:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226041728:12345-0@lo:400:kworker.0 Request processed in 25us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.407208:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788636768.407245:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226040704:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407259:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226041216:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407267:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226041728:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407276:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226041600:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407288:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226041088:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407301:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226040192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636768.407310:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226040064:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407343:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226040320 00000100:00100000:2.0:1788636768.407346:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226040320 00000100:00100000:2.0:1788636768.407367:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226040832 00000100:00100000:2.0:1788636768.407370:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226040832 00000100:00100000:2.0:1788636768.407382:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226041344 00000100:00100000:2.0:1788636768.407385:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226041344 00000100:00100000:2.0:1788636768.407395:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226040576 00000100:00100000:2.0:1788636768.407398:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226040576 00000100:00100000:2.0:1788636768.407407:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226040960 00000100:00100000:2.0:1788636768.407415:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226040960 00000100:00100000:2.0:1788636768.407432:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226041472 00000100:00100000:2.0:1788636768.407435:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226041472 00000100:00100000:2.0:1788636768.407448:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788636768.407454:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521226040320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407500:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521226040320:12345-0@lo:400:kworker.0 Request processed in 32us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.407507:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788636768.407519:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788636768.407525:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226040832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407551:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226040832:12345-0@lo:400:kworker.0 Request processed in 27us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.407557:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788636768.407566:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788636768.407572:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226041344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407596:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226041344:12345-0@lo:400:kworker.0 Request processed in 25us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.407602:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788636768.407611:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788636768.407616:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226040576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407645:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226040576:12345-0@lo:400:kworker.0 Request processed in 28us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.407650:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788636768.407659:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788636768.407664:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226040960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407686:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226040960:12345-0@lo:400:kworker.0 Request processed in 22us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.407697:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788636768.407708:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788636768.407712:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521226041472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407738:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0360bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521226041472:12345-0@lo:400:kworker.0 Request processed in 26us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.407743:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788636768.407766:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226040576:0@lo:400:kworker.0 00000100:00080000:2.0:1788636768.407847:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636768.407856:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636768.407858:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636768.407860:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636768.407924:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef03656300 x1875521226040960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636768.407936:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226040960:0@lo:400:kworker.0 00010000:00080000:2.0:1788636768.407948:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0362df80 x1875521226041472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636768.407957:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521226041472:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407969:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521226040320:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407979:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226040832:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.407989:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226041344:0@lo:400:kworker.0 00000100:00100000:2.0:1788636768.470957:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636768.472383:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207092864 00000100:00100000:0.0:1788636768.472406:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207092864 00000100:00100000:0.0:1788636768.472495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 171 00000100:00100000:0.0:1788636768.472508:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+40:12296:x1875521207092864:12345-192.168.202.26@tcp:101:stat.0 00010000:00010000:0.0:1788636768.472541:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636768.472564:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838da7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39214 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472636:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838dae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472668:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838dae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472682:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838dae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472699:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838db5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472706:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472713:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472802:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472850:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39206 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472861:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472896:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39206 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.472911:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39206 expref: 41 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636768.472936:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03609f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1875521226041984:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636768.473047:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b08d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636768.484645:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636768.485502:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207093120 00000100:00100000:1.0:1788636768.485520:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207093120 00000100:00100000:0.0:1788636768.485568:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03609f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1875521226041984:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636768.485608:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 43 00010000:00010000:0.0:1788636768.485611:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636768.485625:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+42:10781:x1875521207093120:12345-192.168.202.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788636768.486129:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+43:10781:x1875521207093120:12345-192.168.202.26@tcp:35:ldlm_bl.0 Request processed in 507us (1501us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788636768.486178:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 43 00000100:00100000:0.0:1788636768.496054:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.496379:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207093248 00000100:00100000:2.0:1788636768.496389:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207093248 00010000:00010000:2.0:1788636768.496434:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39206 expref: 43 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636768.496482:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 85 00000100:00100000:2.0:1788636768.496493:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+43:2401:x1875521207093248:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636768.496510:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636768.496517:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39206 expref: 43 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.496530:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39206 expref: 43 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.496554:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838d84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39206 expref: 43 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.496569:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636768.496575:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.496585:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.496593:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.496640:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636768.496713:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+42:2401:x1875521207093248:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 221us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.496731:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 85 00010000:00010000:0.0:1788636768.496894:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.496904:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636768.496961:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788636768.496965:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636768.496991:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497006:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497015:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838dae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497022:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838dae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497028:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838dae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497043:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636768.497048:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838dae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497056:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838dae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497067:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:0.0:1788636768.497070:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636768.497074:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838dae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497080:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838dae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497092:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838db5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497098:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838db5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497104:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497109:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636768.497112:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838db5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497118:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838db5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497154:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef021c3600) 00010000:00010000:0.0:1788636768.497156:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636768.497160:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838db5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497166:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838db5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497214:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838da7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39214 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497228:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39214 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.497247:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:0.0:1788636768.497250:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636768.497252:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7000, rc 0) 00000100:00100000:0.0:1788636768.497282:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032406300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+41:12296:x1875521207092864:12345-192.168.202.26@tcp:101:stat.0 Request processed in 24777us (26342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636768.497290:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 171 00000100:00100000:3.0:1788636768.548710:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.548902:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207093504 00000100:00100000:2.0:1788636768.548916:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207093504 00000100:00100000:2.0:1788636768.549048:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 172 00000100:00100000:2.0:1788636768.549059:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+41:12302:x1875521207093504:12345-192.168.202.26@tcp:36:truncate.0 00010000:00010000:2.0:1788636768.549150:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636768.549189:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838dbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39214 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.549220:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636768.549228:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636768.549701:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.549720:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.549733:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788636768.549780:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1788636768.549798:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002032a9a7 reply state 00000000e6a0365d transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.549907:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.549936:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636768.549938:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636768.549941:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636768.550087:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+43:12302:x1875521207093504:12345-192.168.202.26@tcp:36:truncate.0 Request processed in 1029us (1394us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788636768.550096:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 172 00000020:00080000:2.0:1788636768.550102:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788636768.657428:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.657574:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207093632 00000100:00100000:2.0:1788636768.657592:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207093632 00000100:00100000:2.0:1788636768.657787:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 173 00000100:00100000:2.0:1788636768.657800:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+43:12316:x1875521207093632:12345-192.168.202.26@tcp:101:stat.0 00010000:00010000:2.0:1788636768.657883:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636768.657912:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838dca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3921b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658006:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838dd1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658028:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658046:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658067:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658075:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658106:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658316:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658327:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658334:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636768.658391:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788636768.658397:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636768.658420:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658434:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658446:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658453:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838dd1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658461:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658468:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636768.658474:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658491:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838dd1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658506:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:2.0:1788636768.658510:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636768.658518:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838dd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658526:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838dd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658546:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658552:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658558:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658563:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636768.658566:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658571:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658578:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636768.658581:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636768.658584:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dd8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658600:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658639:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838dca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3921b expref: 45 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658726:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3921b expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.658735:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636768.658738:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636768.658741:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0400, rc 0) 00000100:00100000:2.0:1788636768.658912:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+44:12316:x1875521207093632:12345-192.168.202.26@tcp:101:stat.0 Request processed in 1115us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636768.658920:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 173 00010000:00010000:0.0:1788636768.661203:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636768.766757:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636768.767306:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207093888 00000100:00100000:0.0:1788636768.767326:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207093888 00000100:00100000:0.0:1788636768.767426:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 174 00000100:00100000:0.0:1788636768.767440:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+44:12326:x1875521207093888:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636768.767471:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636768.767504:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838de6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39222 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636768.767679:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788636768.767859:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838de6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39222 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.767877:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf015d06300) 00010000:00010000:0.0:1788636768.767881:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636768.767888:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838de6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39222 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636768.767905:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7600, rc 0) 00000100:00100000:0.0:1788636768.768007:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+45:12326:x1875521207093888:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 569us (1266us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788636768.768016:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 174 00000100:00100000:0.0:1788636768.771682:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636768.772202:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207094144 00000100:00100000:3.0:1788636768.772217:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207094144 00000100:00100000:3.0:1788636768.772563:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 44 00000100:00100000:3.0:1788636768.772577:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+45:12326:x1875521207094144:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636768.772938:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+46:12326:x1875521207094144:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 363us (1269us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788636768.772947:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 44 00000100:00100000:1.0:1788636768.835679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.840771:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207094400 00000100:00100000:2.0:1788636768.840794:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207094400 00000100:00100000:2.0:1788636768.841065:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 175 00000100:00100000:2.0:1788636768.841079:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+46:12332:x1875521207094400:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636768.841118:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636768.841152:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838df4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39229 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.841542:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.841564:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3921b expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.841596:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.841642:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3921b expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.841657:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3921b expref: 47 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636768.841674:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226042112:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636768.841869:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02548540 going to sleep for 11 seconds 00000100:00100000:1.0:1788636768.847608:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.847694:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226042112:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636768.847729:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207094528 00010000:00010000:2.0:1788636768.847742:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636768.847743:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207094528 00010000:00010000:3.0:1788636768.847851:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3921b expref: 48 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636768.847899:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 86 00000100:00100000:3.0:1788636768.847914:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+48:2400:x1875521207094528:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636768.847933:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636768.847943:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3921b expref: 48 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.847959:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3921b expref: 48 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.847983:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ddf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3921b expref: 48 pid: 6523 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.848001:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:3.0:1788636768.848006:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.848017:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.848026:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.848057:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636768.848085:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.848096:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636768.848124:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000100:00100000:3.0:1788636768.848134:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03792d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+47:2400:x1875521207094528:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 221us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636768.848143:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 86 00010000:00010000:2.0:1788636768.848367:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838df4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39229 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.848393:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39229 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.848429:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636768.848433:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636768.848437:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0600, rc 0) 00000100:00100000:2.0:1788636768.848682:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+47:12332:x1875521207094400:12345-192.168.202.26@tcp:101:bash.0 Request processed in 7604us (13017us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788636768.848692:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 175 00000100:00100000:1.0:1788636768.857157:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.857481:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207094784 00000100:00100000:2.0:1788636768.857502:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207094784 00000100:00100000:2.0:1788636768.862577:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 176 00000100:00100000:2.0:1788636768.862595:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+47:12332:x1875521207094784:12345-192.168.202.26@tcp:36:bash.0 00010000:00010000:2.0:1788636768.862985:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.863011:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.863026:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788636768.863080:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1788636768.863110:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000227d1aca reply state 00000000280dbcc0 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.863125:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.863133:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636768.863137:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636768.863152:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636768.880797:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+50:12332:x1875521207094784:12345-192.168.202.26@tcp:36:bash.0 Request processed in 18184us (23631us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788636768.880829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 176 00000020:00080000:2.0:1788636768.881116:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788636768.887899:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.888035:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207094912 00000100:00100000:2.0:1788636768.888055:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207094912 00000100:00100000:2.0:1788636768.888218:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 177 00000100:00100000:2.0:1788636768.888256:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+50:12332:x1875521207094912:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636768.888299:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636768.888354:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39230 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.888526:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.888546:0:13298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39229 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.888558:0:13298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.888608:0:13298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39229 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636768.888625:0:13298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39229 expref: 51 pid: 6521 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636768.888644:0:13298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13298:1875521226042240:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636768.888878:0:13298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040900900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636768.891962:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.892130:0:13298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13298:1875521226042240:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636768.892167:0:13298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636768.892316:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207095040 00000100:00100000:3.0:1788636768.892326:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207095040 00010000:00010000:3.0:1788636768.892590:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39229 expref: 52 pid: 6521 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636768.892681:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 87 00000100:00100000:3.0:1788636768.892694:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+52:2401:x1875521207095040:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636768.892713:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636768.892721:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39229 expref: 52 pid: 6521 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.892735:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39229 expref: 52 pid: 6521 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.892762:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838dfb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39229 expref: 52 pid: 6521 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.892781:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:3.0:1788636768.892787:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.892799:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.892863:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636768.892903:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636768.892974:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+51:2401:x1875521207095040:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 282us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636768.893002:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 87 00010000:00010000:1.0:1788636768.893151:0:13298:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636768.893161:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636768.893252:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788636768.893258:0:13298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788636768.893285:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636768.893325:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39230 expref: 51 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636768.893372:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39230 expref: 50 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636768.893381:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:1.0:1788636768.893385:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636768.893388:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0800, rc 0) 00000100:00100000:1.0:1788636768.893427:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+50:12332:x1875521207094912:12345-192.168.202.26@tcp:101:bash.0 Request processed in 5177us (5550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636768.893436:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 177 00000100:00100000:1.0:1788636768.901688:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636768.901861:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207095296 00000100:00100000:2.0:1788636768.901876:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207095296 00000100:00100000:2.0:1788636768.901966:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 45 00000100:00100000:2.0:1788636768.901981:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+50:12332:x1875521207095296:12345-192.168.202.26@tcp:35:bash.0 00000100:00100000:2.0:1788636768.902697:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+51:12332:x1875521207095296:12345-192.168.202.26@tcp:35:bash.0 Request processed in 714us (1022us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788636768.902708:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 45 00000100:00100000:2.0:1788636769.023155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636769.023645:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207095552 00000100:00100000:0.0:1788636769.023661:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207095552 00000100:00100000:0.0:1788636769.023792:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 178 00000100:00100000:0.0:1788636769.023845:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+51:12342:x1875521207095552:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636769.023882:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636769.023910:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39237 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636769.024105:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788636769.024260:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39237 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.024298:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf015d06300) 00010000:00010000:0.0:1788636769.024301:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636769.024308:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39237 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.024323:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7600, rc 0) 00000100:00100000:0.0:1788636769.024875:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+52:12342:x1875521207095552:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1071us (1735us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788636769.024884:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 178 00000100:00100000:1.0:1788636769.031268:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636769.031734:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207095680 00000100:00100000:2.0:1788636769.031760:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207095680 00000100:00100000:2.0:1788636769.032595:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 179 00000100:00100000:2.0:1788636769.032612:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+52:12342:x1875521207095680:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:2.0:1788636769.032732:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e2c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.032757:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.032774:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.032794:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.032848:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.032856:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.032969:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.032980:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.032988:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636769.033057:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033075:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033084:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e2c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033094:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033102:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636769.033109:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033119:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e2c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033146:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:2.0:1788636769.033150:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636769.033157:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033166:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033186:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033193:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033199:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033205:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636769.033209:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033215:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033243:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636769.033245:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636769.033249:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033256:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033288:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033295:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033301:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033306:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636769.033309:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033317:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033324:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636769.033328:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636769.033341:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.033355:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636769.033467:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+52:12342:x1875521207095680:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 859us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636769.033477:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 179 00000100:00100000:1.0:1788636769.045311:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636769.045505:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207095936 00000100:00100000:3.0:1788636769.045519:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207095936 00000100:00100000:3.0:1788636769.045589:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 46 00000100:00100000:3.0:1788636769.045599:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+52:12342:x1875521207095936:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636769.045888:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+53:12342:x1875521207095936:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 291us (593us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788636769.045894:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 46 00000100:00100000:1.0:1788636769.086643:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636769.086849:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207096192 00000100:00100000:2.0:1788636769.086863:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207096192 00000100:00100000:2.0:1788636769.086936:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 180 00000100:00100000:2.0:1788636769.086970:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+53:12345:x1875521207096192:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636769.087005:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636769.087034:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3923e expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087136:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087155:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087171:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087189:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087196:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087203:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087478:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087490:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087498:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636769.087521:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788636769.087632:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087641:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087648:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087655:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636769.087660:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087669:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087685:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:2.0:1788636769.087688:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636769.087694:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087701:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087720:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087728:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087745:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087751:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636769.087755:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087762:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087771:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636769.087774:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636769.087777:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087783:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087895:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3923e expref: 56 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087912:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3923e expref: 55 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.087919:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636769.087922:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636769.087925:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0600, rc 0) 00000100:00100000:2.0:1788636769.088006:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:12345:x1875521207096192:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1039us (1380us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788636769.088024:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 180 00000100:00100000:1.0:1788636769.094571:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636769.095255:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636769.099435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207096448 00000100:00100000:0.0:1788636769.099658:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207096448 00000100:00100000:0.0:1788636769.099793:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 181 00000100:00100000:0.0:1788636769.099873:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:12345:x1875521207096448:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:0.0:1788636769.100011:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.100042:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.100060:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.100111:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.100120:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.100155:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.100162:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636769.100168:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.100178:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.100195:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:0.0:1788636769.100199:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636769.100205:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.100212:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636769.100331:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:12345:x1875521207096448:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 525us (5075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636769.100340:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 181 00000100:00100000:3.0:1788636769.115769:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207096320 00000100:00100000:3.0:1788636769.115791:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207096320 00000100:00100000:1.0:1788636769.116072:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636769.116127:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207096704 00000100:00100000:3.0:1788636769.116131:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207096704 00000100:00100000:3.0:1788636769.116190:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 47 00000100:00100000:3.0:1788636769.116201:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+56:12345:x1875521207096704:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:2.0:1788636769.116210:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00100000:2.0:1788636769.116223:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+56:2401:x1875521207096320:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636769.116260:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636769.116300:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3923e expref: 56 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.116327:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636769.116335:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636769.116437:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:2401:x1875521207096320:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 217us (21889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636769.116447:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00100000:3.0:1788636769.116854:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:12345:x1875521207096704:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 653us (789us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788636769.116864:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 47 00000100:00100000:1.0:1788636769.210697:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636769.211255:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207096960 00000100:00100000:2.0:1788636769.211566:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207096960 00000100:00100000:2.0:1788636769.211685:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 182 00000100:00100000:2.0:1788636769.211695:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:12363:x1875521207096960:12345-192.168.202.26@tcp:101:cat.0 00010000:00010000:2.0:1788636769.211728:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636769.211758:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39245 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.211924:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e72 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.211943:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.211957:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636769.212003:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788636769.212143:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39245 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.212165:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39245 expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.212176:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636769.212179:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788636769.212185:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1e00, rc 0) 00000100:00100000:2.0:1788636769.212287:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+57:12363:x1875521207096960:12345-192.168.202.26@tcp:101:cat.0 Request processed in 592us (1605us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788636769.212294:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 182 00000100:00100000:1.0:1788636769.230790:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636769.231069:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207097088 00000100:00100000:0.0:1788636769.231083:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207097088 00000100:00100000:0.0:1788636769.231172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 183 00000100:00100000:0.0:1788636769.231185:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+57:12364:x1875521207097088:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636769.231222:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636769.231545:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3924c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.231869:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838e87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.231890:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.231904:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636769.231963:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788636769.232108:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636769.232140:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838e87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.232177:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838e80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3924c expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.232199:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838e87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3924c expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636769.232209:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:0.0:1788636769.232213:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636769.232218:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6400, rc 0) 00000100:00100000:0.0:1788636769.232543:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12364:x1875521207097088:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1359us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636769.232552:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 183 00000100:00100000:0.0:1788636769.237164:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636769.237283:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207097472 00000100:00100000:2.0:1788636769.237298:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207097472 00000100:00100000:2.0:1788636769.237390:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 48 00000100:00100000:2.0:1788636769.237403:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12364:x1875521207097472:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:2.0:1788636769.237862:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+59:12364:x1875521207097472:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 459us (712us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788636769.237871:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 48 00000100:00100000:1.0:1788636769.241005:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636769.241647:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207097600 00000100:00100000:3.0:1788636769.241662:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207097600 00000100:00100000:3.0:1788636769.241803:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 15 00000100:00100000:3.0:1788636769.241848:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+59:12364:x1875521207097600:12345-192.168.202.26@tcp:103:lfs.0 00010000:00010000:3.0:1788636769.241872:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788636769.241908:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838e17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39230 expref: 59 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636769.241963:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838e72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39245 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636769.241993:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e838d14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ea expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636769.242005:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:3.0:1788636769.242012:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636769.242081:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+56:12364:x1875521207097600:12345-192.168.202.26@tcp:103:lfs.0 Request processed in 237us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636769.242089:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 15 00000100:00100000:1.0:1788636769.248384:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636769.248551:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207097728 00000100:00100000:2.0:1788636769.248567:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207097728 00000100:00100000:2.0:1788636769.248683:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 184 00000100:00100000:2.0:1788636769.248696:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+56:12364:x1875521207097728:12345-192.168.202.26@tcp:58:lfs.0 00010000:00010000:2.0:1788636769.248911:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e8e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.248947:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.248965:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788636769.249119:0:11089:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788636769.249255:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+56:12364:x1875521207097728:12345-192.168.202.26@tcp:58:lfs.0 Request processed in 560us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636769.249264:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 184 00000100:00100000:0.0:1788636769.263021:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636769.263088:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207097856 00000100:00100000:2.0:1788636769.263103:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207097856 00000100:00100000:2.0:1788636769.263194:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 185 00000100:00100000:2.0:1788636769.263209:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+56:12366:x1875521207097856:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636769.263249:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636769.263287:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39253 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263387:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e9c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263405:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263420:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263444:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ea3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263466:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263473:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263577:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263589:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263596:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636769.263657:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788636769.263663:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636769.263708:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263723:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263733:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e9c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263741:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e9c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263750:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263768:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636769.263774:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e9c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263783:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e9c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263799:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:2.0:1788636769.263803:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636769.263851:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263860:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e838e9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263877:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263884:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ea3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263890:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263895:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636769.263898:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263904:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ea3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263925:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636769.263928:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636769.263931:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ea3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263938:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e838ea3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.263998:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e838e95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39253 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.264014:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39253 expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636769.264022:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636769.264025:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636769.264028:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1e00, rc 0) 00000100:00100000:2.0:1788636769.264112:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+57:12366:x1875521207097856:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 906us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636769.264121:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 185 00010000:00010000:3.0:1788636769.685536:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788636770.199023:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636770.199036:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636770.199085:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788636770.199095:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636770.199284:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226042368:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788636770.199426:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788636770.225600:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636770.226828:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207097984 00000100:00100000:0.0:1788636770.226850:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207097984 00000100:00100000:0.0:1788636770.226974:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 186 00000100:00100000:0.0:1788636770.226992:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12377:x1875521207097984:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788636770.227054:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788636770.227245:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12377:x1875521207097984:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 258us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636770.227256:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 186 00000100:00080000:1.0:1788636770.227629:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636770.230539:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226042368:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788636770.232107:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636770.232501:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207098112 00000100:00100000:3.0:1788636770.232515:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207098112 00000100:00100000:3.0:1788636770.232592:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 187 00000100:00100000:3.0:1788636770.232603:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+57:12377:x1875521207098112:12345-192.168.202.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788636770.232703:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838eb1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.232751:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.232770:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.232789:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838eb8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.232797:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.232803:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.232859:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.232869:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.232877:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636770.232933:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788636770.232937:0:11089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636770.232954:0:11089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233074:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233093:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838eb1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233101:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233108:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636770.233113:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233121:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233136:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:3.0:1788636770.233140:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636770.233146:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838eb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233153:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838eb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233170:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233177:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838eb8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233184:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233188:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636770.233195:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233202:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838eb8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233209:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9cef0217a700) 00010000:00010000:3.0:1788636770.233212:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636770.233215:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838eb8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233221:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838eb8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233267:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233274:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233280:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233286:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636770.233289:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233294:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233302:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:3.0:1788636770.233305:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636770.233313:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.233320:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ebf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636770.234187:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+57:12377:x1875521207098112:12345-192.168.202.26@tcp:34:lhsmtool_posix.0 Request processed in 1578us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636770.234198:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 187 00000100:00100000:1.0:1788636770.257193:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636770.267686:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207098368 00000100:00100000:2.0:1788636770.267709:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207098368 00000100:00100000:3.0:1788636770.268000:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 188 00000100:00100000:3.0:1788636770.268016:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+57:12377:x1875521207098368:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636770.268048:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636770.268083:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ec6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3925a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.268261:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838ecd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.268281:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838ecd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.268299:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838ecd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636770.268313:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788636770.277495:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838ecd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.277522:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838ecd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.277532:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838ecd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.277548:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636770.277554:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838ecd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.277564:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838ecd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.277589:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636770.277593:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636770.277600:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838ecd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.277607:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e838ecd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.277690:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ec6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3925a expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.277703:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:2.0:1788636770.277705:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636770.277710:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e838ec6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3925a expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.277722:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8800, rc 0) 00000100:00100000:2.0:1788636770.277869:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12377:x1875521207098368:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 9855us (20696us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1788636770.277882:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 188 00000100:00100000:1.0:1788636770.284899:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636770.285188:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207098496 00000100:00100000:3.0:1788636770.285201:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207098496 00000100:00100000:3.0:1788636770.285304:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 189 00000100:00100000:3.0:1788636770.285318:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf040990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12377:x1875521207098496:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788636770.286198:0:13298:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788636770.287892:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf040990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12377:x1875521207098496:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 2564us (3078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636770.287923:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 189 00000100:00100000:2.0:1788636770.307535:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636770.307699:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207098752 00000100:00100000:0.0:1788636770.307714:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207098752 00000100:00100000:0.0:1788636770.307786:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 190 00000100:00100000:0.0:1788636770.307799:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12377:x1875521207098752:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636770.307864:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636770.307869:0:11089:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788636770.307922:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838e87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3924c expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.307945:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:0.0:1788636770.307952:0:11089:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636770.307980:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838edb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39261 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788636770.308527:0:11089:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788636770.308696:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838ee2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.308712:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.308733:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.308795:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838edb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39261 expref: 60 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.308849:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39261 expref: 59 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.308860:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cef021c3600) 00010000:00010000:0.0:1788636770.308863:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636770.308866:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6c00, rc 0) 00000100:00100000:0.0:1788636770.308945:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+59:12377:x1875521207098752:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 1149us (1428us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788636770.308956:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 190 00000100:00100000:2.0:1788636770.314573:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636770.315322:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207099008 00000100:00100000:0.0:1788636770.315346:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207099008 00000100:00100000:0.0:1788636770.315421:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 191 00000100:00100000:0.0:1788636770.315434:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+59:12377:x1875521207099008:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788636770.315517:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636770.315553:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838ee2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39261 expref: 59 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.315573:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cef021c3600) 00010000:00010000:0.0:1788636770.315585:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636770.315615:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838ef0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.315646:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838ef0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.315659:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838ef0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322096:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838ef7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8bcb1dcc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322123:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bcb1dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322137:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bcb1dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322196:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838ef0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322203:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838ef0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322210:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838ef0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322216:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636770.322221:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838ef0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322241:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838ef0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322253:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:0.0:1788636770.322274:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636770.322279:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838ef0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322286:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e838ef0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322302:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bcb1dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322308:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bcb1dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322313:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bcb1dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322318:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636770.322321:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bcb1dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322326:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bcb1dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322332:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8bcb1dcc (ffff9cef021c3d00) 00010000:00010000:0.0:1788636770.322335:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636770.322338:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838ef7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8bcb1dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.322345:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838ef7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8bcb1dcc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636770.322483:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12377:x1875521207099008:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 7047us (7919us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636770.322501:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 191 00000100:00100000:3.0:1788636770.324294:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636770.324524:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207099136 00000100:00100000:1.0:1788636770.324536:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207099136 00000100:00100000:1.0:1788636770.324621:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 192 00000100:00100000:1.0:1788636770.324632:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12377:x1875521207099136:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636770.324657:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636770.324686:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838efe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39268 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.324729:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.324744:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.324759:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.326328:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838efe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39268 expref: 60 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.326484:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39268 expref: 59 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.326495:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:1.0:1788636770.326499:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788636770.326503:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36600, rc 0) 00000100:00100000:1.0:1788636770.326633:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+59:12377:x1875521207099136:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 2001us (2355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636770.326643:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 192 00000100:00100000:2.0:1788636770.333444:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636770.333610:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207099392 00000100:00100000:3.0:1788636770.333625:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207099392 00000100:00100000:3.0:1788636770.333763:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 193 00000100:00100000:3.0:1788636770.333781:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+59:12377:x1875521207099392:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636770.334045:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.334068:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.334084:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636770.334320:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788636770.336345:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 439147535005ns, next at 440147526185ns, rc = 0 00000004:00010000:0.0:1788636770.336503:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000141f5806 reply state 00000000c0f8d11f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.336524:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.336728:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:0.0:1788636770.336732:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788636770.336736:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788636770.337070:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:12377:x1875521207099392:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 3289us (3637us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788636770.337081:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 193 00000100:00100000:3.0:1788636770.347779:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636770.350261:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207099520 00000100:00100000:0.0:1788636770.350285:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207099520 00000100:00100000:0.0:1788636770.350373:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 194 00000100:00100000:0.0:1788636770.350386:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:12377:x1875521207099520:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636770.350418:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636770.350447:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3926f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.350528:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3926f expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.350548:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3926f expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.350586:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:0.0:1788636770.350590:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636770.350595:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6000, rc 0) 00000100:00100000:0.0:1788636770.350681:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:12377:x1875521207099520:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 298us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636770.350688:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 194 00000100:00100000:3.0:1788636770.364455:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636770.364749:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207099648 00000100:00100000:2.0:1788636770.364764:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207099648 00000100:00100000:2.0:1788636770.364854:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00100000:2.0:1788636770.364866:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207099648:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788636770.365170:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207099648:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 Request processed in 305us (732us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788636770.365178:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00080000:1.0:1788636770.365374:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636770.376894:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636770.377100:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207099904 00000100:00100000:3.0:1788636770.377115:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207099904 00000100:00100000:3.0:1788636770.377185:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 49 00000100:00100000:3.0:1788636770.377198:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:12377:x1875521207099904:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788636770.377762:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+63:12377:x1875521207099904:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 564us (881us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788636770.377772:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 49 00000100:00100000:0.0:1788636770.386653:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636770.386717:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207100160 00000100:00100000:0.0:1788636770.386730:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207100160 00000100:00100000:0.0:1788636770.386795:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 195 00000100:00100000:0.0:1788636770.386828:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+63:12377:x1875521207100160:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788636770.387676:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+63:12377:x1875521207100160:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 865us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636770.387690:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 195 00000100:00100000:3.0:1788636770.390840:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636770.394831:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207100288 00000100:00100000:0.0:1788636770.394853:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207100288 00000100:00100000:0.0:1788636770.394971:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 196 00000100:00100000:0.0:1788636770.394984:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+63:12377:x1875521207100288:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636770.395013:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636770.395045:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39276 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.395137:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.395176:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.395191:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636770.395264:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636770.395290:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.395338:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39276 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.395362:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39276 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.395371:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:0.0:1788636770.395375:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788636770.395379:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7600, rc 0) 00000100:00100000:0.0:1788636770.395477:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+64:12377:x1875521207100288:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 495us (4648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636770.395485:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 196 00000100:00100000:3.0:1788636770.408244:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636770.408368:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207100416 00000100:00100000:1.0:1788636770.408398:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207100416 00000100:00100000:1.0:1788636770.408466:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:1.0:1788636770.408479:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207100416:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636770.408504:0:9847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636770.408531:0:9847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064e4850b/0x5b741ef42e838f28 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3927d expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636770.408568:0:9847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c6e62, blocks: 0x0 00010000:00010000:1.0:1788636770.408593:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1788636770.408598:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636770.408609:0:9847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064e4850b/0x5b741ef42e838f28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3927d expref: 8 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.408633:0:9847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064e4850b/0x5b741ef42e838f28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3927d expref: 8 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.408649:0:9847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36e00, rc 0) 00000100:00100000:1.0:1788636770.408729:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2400:x1875521207100416:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 253us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636770.408737:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:1.0:1788636770.413232:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636770.413339:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207100672 00000100:00100000:3.0:1788636770.413354:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207100672 00000100:00100000:3.0:1788636770.413428:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 197 00000100:00100000:3.0:1788636770.413458:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+64:12377:x1875521207100672:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788636770.413612:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+64:12377:x1875521207100672:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 157us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636770.413620:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 197 00000100:00100000:1.0:1788636770.419408:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636770.419462:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207100800 00000100:00100000:1.0:1788636770.419477:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207100800 00000100:00100000:1.0:1788636770.419557:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:1.0:1788636770.419570:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:12377:x1875521207100800:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636770.419607:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636770.419633:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39284 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.419676:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064e4850b/0x5b741ef42e838f28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3927d expref: 9 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.419687:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636770.419692:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636770.419698:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 9 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.419740:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064e4850b/0x5b741ef42e838f28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3927d expref: 9 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.419757:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064e4850b/0x5b741ef42e838f28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3927d expref: 9 pid: 9847 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636770.419775:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1875521226042496:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636770.419903:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf007de4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636770.431744:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636770.433379:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207100928 00000100:00100000:3.0:1788636770.433395:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207100928 00010000:00010000:3.0:1788636770.433459:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064e4850b/0x5b741ef42e838f28 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3927d expref: 10 pid: 9847 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636770.433683:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 88 00000100:00100000:3.0:1788636770.433695:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:2401:x1875521207100928:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636770.433715:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636770.433748:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064e4850b/0x5b741ef42e838f28 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3927d expref: 10 pid: 9847 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.433764:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064e4850b/0x5b741ef42e838f28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3927d expref: 10 pid: 9847 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.433796:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636770.433802:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636770.433836:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 10 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.433847:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 10 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.433914:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 10 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636770.433931:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1875521226042624:192.168.202.26@tcp:105: 00000100:00100000:3.0:1788636770.435297:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636770.445164:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1875521226042624:192.168.202.26@tcp:105: 00010000:00010000:1.0:1788636770.445207:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636770.445296:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:2401:x1875521207100928:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 11603us (13566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636770.445312:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 88 00010000:00010000:2.0:1788636770.446011:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064e4850b/0x5b741ef42e838f28 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3927d expref: 9 pid: 9847 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636770.446030:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1875521226042496:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636770.446059:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.446078:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36400, rc 0) 00000100:00100000:2.0:1788636770.446121:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:12377:x1875521207100800:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 26554us (26729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636770.446130:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:1.0:1788636770.454673:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636770.454728:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207101056 00000100:00100000:1.0:1788636770.454740:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207101056 00002000:00100000:1.0:1788636770.454801:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9cef035f5500 x1875521207101056/t0(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:256/0 lens 504/0 e 0 to 0 dl 1788636781 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636770.454841:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef035f5500 with x1875521207101056 ext(0->8) 00002000:00010000:1.0:1788636770.454848:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef035f5500 00000100:00100000:1.0:1788636770.454880:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 4 00000100:00100000:1.0:1788636770.454891:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2399:x1875521207101056:12345-192.168.202.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788636770.463884:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:2399:x1875521207101056:12345-192.168.202.26@tcp:4:lhsmtool_posix.0 Request processed in 8974us (9208us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788636770.463905:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 4 00002000:00100000:0.0:1788636770.463926:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9cef035f5500 x1875521207101056/t4294967315(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:256/0 lens 504/448 e 0 to 0 dl 1788636781 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636770.463953:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef035f5500 with x1875521207101056 ext(0->8) 00002000:00010000:0.0:1788636770.465415:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef035f5500 00000040:00080000:0.0:1788636770.475835:0:14664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636770.475849:0:14664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636770.475885:0:14664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788636770.475894:0:14664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636770.477016:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636770.477180:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207101184 00000100:00100000:2.0:1788636770.477203:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207101184 00000100:00100000:2.0:1788636770.477291:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 198 00000100:00100000:2.0:1788636770.477304:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+64:12377:x1875521207101184:12345-192.168.202.26@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788636770.480125:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1788636770.480152:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788636770.480261:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788636770.480285:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf03a9f0000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788636770.480291:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cef041fdf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf03a9f0180 00000020:00080000:3.0:1788636770.480294:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cef041fd800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cef037c1a00 00010000:00010000:0.0:1788636770.480667:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480686:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480698:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788636770.480699:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:0.0:1788636770.480725:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636770.480732:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480742:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480767:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00000020:00080000:3.0:1788636770.480770:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788636770.480772:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636770.480780:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480788:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e838da0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480859:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480867:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480875:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480881:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636770.480884:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480892:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480902:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:0.0:1788636770.480905:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636770.480908:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480915:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838dc3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480929:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480936:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480943:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.480954:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636770.480963:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636770.480965:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:12377:x1875521207101184:12345-192.168.202.26@tcp:44:lhsmtool_posix.0 Request processed in 3652us (3948us total) trans 0 rc 0/0 00010000:00010000:0.0:1788636770.480984:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636770.481000:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 198 00010000:00010000:0.0:1788636770.481005:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:0.0:1788636770.481010:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636770.481014:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.481021:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e838e09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.481037:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.481045:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.481051:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.481056:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636770.481058:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.481065:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.481085:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:0.0:1788636770.481088:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788636770.481091:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.481097:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e838f0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636770.481209:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226042752:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788636770.481308:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636770.481395:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226042752 00000100:00100000:2.0:1788636770.481403:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226042752 00000100:00100000:2.0:1788636770.481463:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788636770.481474:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226042752:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788636770.481513:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00000100:00100000:1.0:1788636770.481635:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636770.481654:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226042880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788636770.481722:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636770.481769:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226042880 00000100:00100000:1.0:1788636770.481776:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226042880 00000100:00100000:1.0:1788636770.481835:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788636770.481845:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226042880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788636770.481952:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788636770.481956:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788636770 00002000:00010000:1.0:1788636770.481959:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788636770.481962:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788636770 -> 1788636770 00002000:00010000:1.0:1788636770.481965:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788636770.482008:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03609f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875521226042880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (286us total) trans 4294967316 rc 0/0 00002000:00010000:2.0:1788636770.482011:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c6e5f, atime: 0x6a9c6e5f, ctime: 0x6a9c6e5f, blocks: 0x8 00000100:00100000:1.0:1788636770.482020:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1788636770.482024:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e838f36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.482044:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1788636770.482050:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636770.482059:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e838f36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788636770.482065:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf012918000/2, rc 0, transno 4294967316 00010000:00010000:2.0:1788636770.482080:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e838f36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636770.482090:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226042880:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788636770.482096:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e838f36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.482107:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e838f36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.482143:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788636770.483629:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1875521226042752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2150us (2315us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788636770.483641:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788636770.483679:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636770.483685:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788636770.483712:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636770.483721:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e838f36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.483733:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636770.483738:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e838f36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.483750:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e838f36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.483776:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e838f36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.483785:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000125ec5ff/0x5b741ef42e838f36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.483848:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636770.483851:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636770.483854:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788636770.484135:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf03fcc0380/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788636770.484151:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226042752:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788636770.517140:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636770.517214:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207101312 00000100:00100000:2.0:1788636770.517233:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207101312 00000100:00100000:2.0:1788636770.517295:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:2.0:1788636770.517307:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:2400:x1875521207101312:12345-192.168.202.26@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788636770.523284:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1788636770.523296:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1788636770.523478:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207101312:12345-192.168.202.26@tcp:16:lhsmtool_posix.0 Request processed in 6167us (6351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636770.523492:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:3.0:1788636770.529302:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636770.531492:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207101568 00000100:00100000:0.0:1788636770.531527:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207101568 00000100:00100000:0.0:1788636770.531612:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 199 00000100:00100000:0.0:1788636770.531626:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:12377:x1875521207101568:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788636770.531702:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636770.531738:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39276 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.531761:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:0.0:1788636770.531767:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636770.531822:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.531839:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.531853:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788636770.532048:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000079af8d8 reply state 00000000d28a7904 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.532077:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.532084:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:0.0:1788636770.532087:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788636770.532091:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788636770.532611:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:12377:x1875521207101568:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 984us (3320us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1788636770.532623:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 199 00000100:00100000:3.0:1788636770.539414:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636770.539659:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207101696 00000100:00100000:0.0:1788636770.539673:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207101696 00000100:00100000:0.0:1788636770.539751:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:0.0:1788636770.539765:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2399:x1875521207101696:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788636770.539991:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788636770.539996:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788636770 -> 1788636769 00002000:00010000:0.0:1788636770.540000:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788636767 00002000:00010000:0.0:1788636770.540003:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788636770 -> 1788636769 00002000:00010000:0.0:1788636770.540006:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788636770.540082:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2399:x1875521207101696:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 Request processed in 320us (682us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788636770.540091:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:2.0:1788636770.550015:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636770.552024:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207101952 00000100:00100000:1.0:1788636770.552043:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207101952 00000100:00100000:1.0:1788636770.552149:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 200 00000100:00100000:1.0:1788636770.552166:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:12377:x1875521207101952:12345-192.168.202.26@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788636770.553453:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.553481:0:13298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39268 expref: 20 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.553491:0:13298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.553536:0:13298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39268 expref: 20 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.553555:0:13298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39268 expref: 20 pid: 13298 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636770.553570:0:13298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13298:1875521226043008:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636770.553693:0:13298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0110d5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636770.557185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636770.557406:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207102080 00000100:00100000:3.0:1788636770.557421:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207102080 00010000:00010000:3.0:1788636770.557512:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39268 expref: 21 pid: 13298 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636770.557517:0:13298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13298:1875521226043008:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636770.557565:0:13298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636770.557610:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 89 00000100:00100000:3.0:1788636770.557624:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:2400:x1875521207102080:12345-192.168.202.26@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788636770.557625:0:6507:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788636770.557647:0:6507:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788636770.557654:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636770.557666:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39268 expref: 21 pid: 13298 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.557686:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39268 expref: 21 pid: 13298 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.557729:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e838f05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39268 expref: 21 pid: 13298 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.557749:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:3.0:1788636770.557755:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.557767:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.557777:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.557847:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636770.557905:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:2400:x1875521207102080:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 284us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636770.557913:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 89 00010000:00010000:1.0:1788636770.558259:0:13298:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.558273:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.558318:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.558326:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.558334:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.558340:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636770.558344:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.558352:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.558368:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:1.0:1788636770.558371:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788636770.558376:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.558382:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f44 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636770.558469:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:12377:x1875521207101952:12345-192.168.202.26@tcp:55:lhsmtool_posix.0 Request processed in 6306us (8467us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788636770.558480:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 200 00000100:00100000:3.0:1788636770.560366:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636770.560488:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207102208 00000100:00100000:2.0:1788636770.560511:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207102208 00000100:00100000:2.0:1788636770.560576:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 65 00000100:00100000:2.0:1788636770.560588:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2398:x1875521207102208:12345-192.168.202.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788636770.560660:0:9845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.560690:0:9845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.560701:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636770.560707:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636770.560720:0:9845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.560773:0:9845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.560803:0:9845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 8 pid: 8438 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636770.560851:0:9845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9845:1875521226043136:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636770.561129:0:9845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040900900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636770.562945:0:9845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9845:1875521226043136:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636770.562993:0:9845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636770.563696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636770.563887:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207102336 00000100:00100000:1.0:1788636770.563896:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207102336 00010000:00010000:1.0:1788636770.563943:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 9 pid: 8438 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636770.563987:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 90 00000100:00100000:1.0:1788636770.563998:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2401:x1875521207102336:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636770.564017:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636770.564044:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 9 pid: 8438 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.564060:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 9 pid: 8438 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.564085:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f38e10d/0x5b741ef42e838f2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39284 expref: 9 pid: 8438 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.564106:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636770.564110:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636770.564117:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.564128:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.564159:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636770.564241:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207102336:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 244us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636770.564267:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 90 00010000:00010000:2.0:1788636770.565447:0:9845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.565466:0:9845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.565513:0:9845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.565524:0:9845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.565532:0:9845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.565566:0:9845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1200 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636770.565572:0:9845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.565584:0:9845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.565607:0:9845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.565616:0:9845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000125ec5ff/0x5b741ef42e838f4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636770.565731:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2398:x1875521207102208:12345-192.168.202.26@tcp:1:lhsmtool_posix.0 Request processed in 5142us (5375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636770.565742:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 65 00000100:00100000:3.0:1788636770.567745:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636770.568062:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207102592 00000100:00100000:2.0:1788636770.568075:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207102592 00000100:00100000:2.0:1788636770.568194:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 201 00000100:00100000:2.0:1788636770.568206:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:12377:x1875521207102592:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788636770.568345:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.568367:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3920d expref: 19 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.568396:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.568441:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3920d expref: 19 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.568459:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3920d expref: 19 pid: 11089 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636770.568478:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03aba5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226043264:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636770.568637:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040900900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636770.573163:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03aba5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226043264:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636770.573202:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636770.582346:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636770.582426:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207102720 00000100:00100000:1.0:1788636770.582446:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207102720 00010000:00010000:1.0:1788636770.582524:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3920d expref: 20 pid: 11089 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636770.589797:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 91 00000100:00100000:2.0:1788636770.589849:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:2400:x1875521207102720:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636770.589876:0:14670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636770.589891:0:14670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3920d expref: 20 pid: 11089 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.589912:0:14670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3920d expref: 20 pid: 11089 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.589940:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8000/0x5b741ef42e838d99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3920d expref: 20 pid: 11089 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.589969:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636770.589975:0:14670:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.589987:0:14670:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.589997:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.590029:0:14670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636770.590103:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:2400:x1875521207102720:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 265us (7773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636770.590294:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 91 00010000:00010000:1.0:1788636770.590576:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.590587:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.591025:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.591041:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f13 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3926f expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.591051:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.591088:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3926f expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.591103:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f13 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3926f expref: 19 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636770.591120:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226043392:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636770.591203:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a61e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636770.601679:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636770.601852:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207102848 00000100:00100000:0.0:1788636770.601882:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207102848 00010000:00010000:0.0:1788636770.601943:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f13 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3926f expref: 20 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636770.601985:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 92 00000100:00100000:0.0:1788636770.601996:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aba5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:2400:x1875521207102848:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636770.602015:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636770.602023:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f13 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3926f expref: 20 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.602040:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f13 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3926f expref: 20 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.602075:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:0.0:1788636770.602082:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.602094:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.602104:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636770.602128:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636770.602197:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aba5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:2400:x1875521207102848:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 202us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636770.602204:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 92 00010000:00010000:3.0:1788636770.605758:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3926f expref: 19 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636770.605791:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03792d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226043392:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636770.605842:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.605853:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.605860:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636770.606170:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788636770.606397:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788636770.606433:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788636770.606675:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1875521226043520:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788636770.606764:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636770.607065:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636770.610857:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226043520 00000100:00100000:0.0:1788636770.610875:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226043520 00000100:00100000:0.0:1788636770.610959:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788636770.610981:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1875521226043520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788636770.611147:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1875521226043520:12345-0@lo:1000:mdt00_000.0 Request processed in 168us (4382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636770.611154:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788636770.611510:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1788636770.611522:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf012918000, transno 4294967316 00000100:00100000:1.0:1788636770.611539:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1875521226043520:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788636770.611730:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1788636770.611840:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03790000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1875521226043648:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788636770.611889:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636770.611915:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaae180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636770.613701:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226043648 00000100:00100000:2.0:1788636770.613714:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226043648 00000100:00100000:2.0:1788636770.613773:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788636770.613783:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1875521226043648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788636770.613998:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6521:x1875521226043648:12345-0@lo:1000:mdt00_000.0 Request processed in 216us (2109us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788636770.614006:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788636770.614675:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03790000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6521:1875521226043648:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788636770.614734:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614747:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614756:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614763:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636770.614768:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614778:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614798:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:1.0:1788636770.614801:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636770.614832:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614840:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e838f59 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614875:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614881:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e8e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614888:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614894:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636770.614897:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614904:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e8e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614912:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:1.0:1788636770.614915:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636770.614917:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e8e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614923:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e838e8e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614951:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614978:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39253 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.614989:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.615035:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39253 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.615053:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39253 expref: 22 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636770.615069:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226043776:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636770.615163:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaae180 going to sleep for 11 seconds 00000100:00100000:1.0:1788636770.618912:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1875521226043776:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636770.618951:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636770.623801:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636770.623912:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207102976 00000100:00100000:2.0:1788636770.623925:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207102976 00010000:00010000:2.0:1788636770.623985:0:14670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39253 expref: 23 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636770.624043:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 93 00000100:00100000:2.0:1788636770.624071:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:2400:x1875521207102976:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636770.624090:0:14670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636770.624098:0:14670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39253 expref: 23 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.624114:0:14670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39253 expref: 23 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.624146:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e838eaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39253 expref: 23 pid: 6523 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.624168:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:2.0:1788636770.624175:0:14670:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.624189:0:14670:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.624199:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.624242:0:14670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636770.624308:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:2400:x1875521207102976:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 239us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636770.624316:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 93 00010000:00010000:3.0:1788636770.624562:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624573:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624591:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624600:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624614:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624622:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636770.624627:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624636:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624646:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:3.0:1788636770.624649:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636770.624653:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624660:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e838f60 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624671:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624677:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624683:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624689:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636770.624692:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624706:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624714:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cf015d06d00) 00010000:00010000:3.0:1788636770.624716:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636770.624719:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636770.624725:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e838f52 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636770.625004:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:12377:x1875521207102592:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 56799us (57272us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788636770.625014:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 201 00000020:00080000:3.0:1788636770.625018:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788636770.625784:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636770.625792:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636770.626461:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788636770.626474:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636770.629748:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636770.629854:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207103232 00000100:00100000:3.0:1788636770.629867:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207103232 00000100:00100000:3.0:1788636770.629945:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 50 00000100:00100000:3.0:1788636770.629957:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:12377:x1875521207103232:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788636770.632606:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788636770.632677:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1788636770.632772:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.632800:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.632891:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.632904:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.632913:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.632922:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636770.632953:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636770.632987:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636770.632999:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.633009:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636770.633015:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.633026:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.633044:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:1.0:1788636770.633048:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788636770.633062:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.633070:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e838f67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636770.633083:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636770.633085:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636770.633088:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636770.633108:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:12377:x1875521207103232:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 3147us (3369us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788636770.633120:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 50 00000020:00080000:2.0:1788636770.633128:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788636770.712112:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636770.965403:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636770.965512:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226044032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636770.965606:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636770.965697:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226044032 00000100:00100000:1.0:1788636770.965706:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226044032 00000100:00100000:1.0:1788636770.965775:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788636770.965784:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226044032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636770.965876:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636770.965932:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226044032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636770.965940:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1788636770.965966:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636770.966029:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226044032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636770.966064:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636770.966073:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226044160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636770.966098:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636770.967944:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226044160 00000100:00100000:3.0:1788636770.967960:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226044160 00000100:00100000:3.0:1788636770.968022:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788636770.968033:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875521226044160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636770.968058:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636770.968162:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875521226044160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636770.968203:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788636770.968550:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226044160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636770.968834:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226043904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636770.968904:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636770.968992:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226043904 00000100:00100000:2.0:1788636770.968999:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226043904 00000100:00100000:2.0:1788636770.969047:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788636770.969067:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226043904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636770.969104:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636770.969175:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226043904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636770.969182:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788636770.969424:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226043904:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788636771.733176:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636772.001177:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636772.001225:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef02461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226044288:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636772.001349:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636772.001488:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226044288 00000100:00100000:2.0:1788636772.001498:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226044288 00000100:00100000:2.0:1788636772.001568:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788636772.001581:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226044288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788636772.001638:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788636772.001708:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226044288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636772.001716:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788636772.001777:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef02461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226044288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636772.480242:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636772.480294:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636772.480324:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636772.480362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636772.480390:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636772.480412:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636772.480434:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636772.480460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207103360 00000100:00100000:3.0:1788636772.480470:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207103360 00000100:00100000:3.0:1788636772.480520:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 400 00000100:00100000:3.0:1788636772.480531:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207103360:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636772.480600:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207103360:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 70us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636772.480607:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 400 00000100:00100000:3.0:1788636772.480641:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207103488 00000100:00100000:3.0:1788636772.480645:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207103488 00000100:00100000:3.0:1788636772.480680:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207104000 00000100:00100000:3.0:1788636772.480683:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207104000 00000100:00100000:3.0:1788636772.480694:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207103616 00000100:00100000:3.0:1788636772.480696:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207103616 00000100:00100000:3.0:1788636772.480706:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207104128 00000100:00100000:3.0:1788636772.480708:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207104128 00000100:00100000:3.0:1788636772.480735:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 370 00000100:00100000:3.0:1788636772.480742:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:2400:x1875521207103488:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636772.480776:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:2400:x1875521207103488:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 34us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636772.480801:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 370 00000100:00100000:3.0:1788636772.480848:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 371 00000100:00100000:1.0:1788636772.480988:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 372 00000100:00100000:1.0:1788636772.481004:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207103616:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636772.481034:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207103616:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 33us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636772.481040:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 372 00000100:00100000:1.0:1788636772.481054:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 373 00000100:00100000:1.0:1788636772.481060:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207104128:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636772.481079:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207104128:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 20us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636772.481085:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 373 00000100:00100000:3.0:1788636772.481289:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207104000:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636772.481469:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207103744 00000100:00100000:2.0:1788636772.481475:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207103744 00000100:00100000:2.0:1788636772.481517:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207103872 00000100:00100000:2.0:1788636772.481521:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207103872 00000100:00100000:2.0:1788636772.481559:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 147 00000100:00100000:2.0:1788636772.481568:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207103744:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636772.481607:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207103744:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 41us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636772.481614:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 147 00000100:00100000:2.0:1788636772.481627:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 148 00000100:00100000:2.0:1788636772.481633:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207103872:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636772.481658:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207103872:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 25us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636772.481675:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 148 00000100:00100000:3.0:1788636772.482588:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207104000:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 1722us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636772.482599:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 371 00000100:00080000:3.0:1788636772.482648:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636772.482654:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636772.482659:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636772.482661:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788636772.503386:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788636772.697845:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636772.697856:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636772.697885:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788636772.697895:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788636772.759744:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788636772.850476:0:14716:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636772.850486:0:14716:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636772.850525:0:14716:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788636772.850532:0:14716:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636773.004489:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636773.004623:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207104384 00000100:00100000:3.0:1788636773.004635:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207104384 00000100:00100000:3.0:1788636773.004704:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 202 00000100:00100000:3.0:1788636773.004714:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:12395:x1875521207104384:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636773.004736:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636773.004759:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838f6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3928b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.004915:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838f75 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.004931:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838f75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.004945:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838f75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636773.004983:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788636773.005092:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838f6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3928b expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.005122:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838f75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3928b expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.005132:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:3.0:1788636773.005135:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788636773.005138:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9000, rc 0) 00000100:00100000:3.0:1788636773.005195:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:12395:x1875521207104384:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 482us (720us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788636773.005202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 202 00000100:00100000:3.0:1788636773.011005:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636773.022436:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207104512 00000100:00100000:0.0:1788636773.022450:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207104512 00000100:00100000:0.0:1788636773.022517:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 203 00000100:00100000:0.0:1788636773.022528:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:12395:x1875521207104512:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:0.0:1788636773.022618:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022638:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022649:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022667:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022674:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022679:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022777:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022786:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022793:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788636773.022871:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022885:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022891:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f83 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022899:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022905:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636773.022909:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022917:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022928:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:0.0:1788636773.022932:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636773.022938:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022951:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e838f83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022965:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022971:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022976:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022981:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636773.022984:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022990:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.022998:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef021c3e00) 00010000:00010000:0.0:1788636773.023001:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636773.023004:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.023010:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e838f8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.023023:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.023029:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.023042:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.023047:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636773.023049:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.023055:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.023063:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef021c3400) 00010000:00010000:0.0:1788636773.023065:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636773.023068:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.023074:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e838f91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636773.023156:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:12395:x1875521207104512:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 628us (12161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.023165:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 203 00000001:00080000:0.0:1788636773.024664:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1788636773.024679:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1788636773.085456:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636773.085500:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207104768 00000100:00100000:3.0:1788636773.085513:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207104768 00000100:00100000:3.0:1788636773.089751:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 204 00000100:00100000:3.0:1788636773.089778:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:12399:x1875521207104768:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636773.089819:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636773.089841:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838f98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39292 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.089931:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838f9f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.089947:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838f9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.089970:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838f9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.089986:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fa6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.089994:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090000:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090119:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090128:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090136:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636773.090147:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788636773.090234:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838f9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090242:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838f9f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090249:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090255:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636773.090266:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838f9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090275:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838f9f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090288:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:3.0:1788636773.090291:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636773.090296:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838f9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090304:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838f9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090332:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090339:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fa6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090345:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090351:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636773.090354:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090361:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fa6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090369:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217ac00) 00010000:00010000:3.0:1788636773.090372:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636773.090382:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fa6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090389:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fa6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090435:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838f98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39292 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090450:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39292 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.090458:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:3.0:1788636773.090460:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636773.090463:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8600, rc 0) 00000100:00100000:3.0:1788636773.090545:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:12399:x1875521207104768:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 779us (5102us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788636773.090554:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 204 00000100:00100000:1.0:1788636773.097026:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636773.097064:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207104896 00000100:00100000:1.0:1788636773.097073:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207104896 00000100:00100000:1.0:1788636773.097128:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 205 00000100:00100000:1.0:1788636773.097138:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0351b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:12399:x1875521207104896:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:1.0:1788636773.097209:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.097238:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.097249:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.097301:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.097308:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fbb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.097656:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.097664:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636773.097668:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.097677:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.097692:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:1.0:1788636773.097695:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636773.097702:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fbb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.097709:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636773.097788:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0351b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:12399:x1875521207104896:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 651us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636773.097796:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 205 00000100:00100000:2.0:1788636773.102110:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636773.102708:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207105152 00000100:00100000:1.0:1788636773.102720:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207105152 00000100:00100000:1.0:1788636773.102782:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 51 00000100:00100000:1.0:1788636773.102833:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:12399:x1875521207105152:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:1.0:1788636773.103100:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+28:12399:x1875521207105152:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 293us (1000us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788636773.103108:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 51 00000100:00100000:2.0:1788636773.145328:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636773.147074:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207105408 00000100:00100000:3.0:1788636773.147096:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207105408 00000100:00100000:3.0:1788636773.147184:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 206 00000100:00100000:3.0:1788636773.147196:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+28:11922:x1875521207105408:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636773.147238:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636773.147263:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838fc2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39299 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.147387:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.147425:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39292 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.147435:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.147473:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39292 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.147486:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39292 expref: 29 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636773.147500:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226044416:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636773.147627:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636773.156968:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636773.157266:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226044416:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636773.157323:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636773.157578:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207105536 00000100:00100000:0.0:1788636773.157587:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207105536 00010000:00010000:0.0:1788636773.157633:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39292 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636773.157679:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 94 00000100:00100000:0.0:1788636773.157690:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:2400:x1875521207105536:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636773.157723:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636773.157730:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39292 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.157744:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39292 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.157767:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8600/0x5b741ef42e838fad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39292 expref: 30 pid: 6521 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.157783:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:0.0:1788636773.157788:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.157798:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.157849:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.157875:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636773.157928:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:2400:x1875521207105536:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 239us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.157937:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 94 00010000:00010000:1.0:1788636773.159091:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.159104:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636773.159124:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788636773.159270:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8200/0x5b741ef42e838fc2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39299 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.159291:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39299 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.159301:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:1.0:1788636773.159303:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788636773.159307:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9400, rc 0) 00000100:00100000:1.0:1788636773.159373:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:11922:x1875521207105408:12345-192.168.202.26@tcp:101:bash.0 Request processed in 12179us (14062us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788636773.159380:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 206 00000100:00100000:1.0:1788636773.170912:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636773.171127:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207105664 00000100:00100000:3.0:1788636773.171139:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207105664 00000100:00100000:3.0:1788636773.171242:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 207 00000100:00100000:3.0:1788636773.171253:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:11922:x1875521207105664:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636773.171278:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636773.171302:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838fd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392a0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.171342:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838fde lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.171371:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838fde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.171383:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838fde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.171497:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e838fd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392a0 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.171513:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838fde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392a0 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.171519:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:3.0:1788636773.171522:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636773.171524:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8a00, rc 0) 00000100:00100000:3.0:1788636773.171579:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11922:x1875521207105664:12345-192.168.202.26@tcp:101:bash.0 Request processed in 328us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636773.171586:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 207 00000100:00100000:2.0:1788636773.177467:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636773.178281:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207105920 00000100:00100000:1.0:1788636773.178300:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207105920 00000100:00100000:1.0:1788636773.178512:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 208 00000100:00100000:1.0:1788636773.178550:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef02461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:11922:x1875521207105920:12345-192.168.202.26@tcp:36:bash.0 00010000:00010000:1.0:1788636773.178970:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.178999:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.179016:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636773.179079:0:13298:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788636773.179109:0:13298:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a228d78 reply state 000000008a0d07d3 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.179123:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.179132:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:1.0:1788636773.179136:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788636773.179140:0:13298:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788636773.179182:0:13298:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788636773.179320:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef02461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+34:11922:x1875521207105920:12345-192.168.202.26@tcp:36:bash.0 Request processed in 773us (1863us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788636773.179328:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 208 00000020:00080000:1.0:1788636773.179333:0:13298:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788636773.186954:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636773.187046:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207106048 00000100:00100000:1.0:1788636773.187056:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207106048 00000100:00100000:1.0:1788636773.187143:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 209 00000100:00100000:1.0:1788636773.187154:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+34:11922:x1875521207106048:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:1.0:1788636773.187180:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636773.187219:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e838fec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392a7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.187280:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e838fec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392a7 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.187295:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e838fec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392a7 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.187313:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:1.0:1788636773.187317:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636773.187321:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37e00, rc 0) 00000100:00100000:1.0:1788636773.187377:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+35:11922:x1875521207106048:12345-192.168.202.26@tcp:101:bash.0 Request processed in 224us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636773.187402:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 209 00000100:00100000:2.0:1788636773.192336:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636773.192531:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207106176 00000100:00100000:0.0:1788636773.192542:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207106176 00000100:00100000:0.0:1788636773.192624:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 66 00000100:00100000:0.0:1788636773.192635:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:11922:x1875521207106176:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:0.0:1788636773.192672:0:9845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636773.192697:0:9845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015d83446/0x5b741ef42e838ff3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392ae expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788636773.192733:0:9845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c6e61, atime: 0x6a9c6e5f, ctime: 0x6a9c6e61, blocks: 0x8 00010000:00010000:0.0:1788636773.192767:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1788636773.192773:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636773.192782:0:9845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015d83446/0x5b741ef42e838ff3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ae expref: 8 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.192802:0:9845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000015d83446/0x5b741ef42e838ff3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ae expref: 8 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.192861:0:9845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6000, rc 0) 00000100:00100000:0.0:1788636773.192927:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:11922:x1875521207106176:12345-192.168.202.26@tcp:101:bash.0 Request processed in 294us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.192934:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 66 00000100:00100000:2.0:1788636773.195638:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636773.195698:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207106304 00000100:00100000:1.0:1788636773.195708:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207106304 00002000:00010000:1.0:1788636773.195753:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788636773.195770:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef04250380 with x1875521207106304 ext(0->18446744073709551615) 00002000:00010000:1.0:1788636773.195783:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef04250380. 00000100:00100000:1.0:1788636773.195854:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 5 00000100:00100000:1.0:1788636773.195865:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207106304:12345-192.168.202.26@tcp:10:bash.0 00002000:00010000:1.0:1788636773.196117:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788636773.196121:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788636769 -> 1788636773 00002000:00010000:1.0:1788636773.196123:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788636767 -> 1788636767 00002000:00010000:1.0:1788636773.196125:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788636769 -> 1788636773 00002000:00010000:1.0:1788636773.196128:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788636773.196198:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2401:x1875521207106304:12345-192.168.202.26@tcp:10:bash.0 Request processed in 334us (570us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788636773.196206:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 5 00002000:00010000:1.0:1788636773.196224:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:1.0:1788636773.196228:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef04250380 with x1875521207106304 ext(0->18446744073709551615) 00002000:00010000:1.0:1788636773.196233:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef04250380. 00000100:00100000:2.0:1788636773.354552:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636773.354677:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207106432 00000100:00100000:1.0:1788636773.354690:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207106432 00000100:00100000:1.0:1788636773.354772:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 210 00000100:00100000:1.0:1788636773.354783:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+35:12413:x1875521207106432:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:1.0:1788636773.355202:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e838ffa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355235:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e838ffa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355250:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e838ffa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355499:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839001 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355510:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355518:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355613:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355645:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355653:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636773.355752:0:11089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355773:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e838ffa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355780:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e838ffa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355788:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e838ffa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355793:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636773.355797:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e838ffa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355831:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e838ffa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355845:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:1.0:1788636773.355848:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636773.355853:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e838ffa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355860:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e838ffa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355883:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355889:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839001 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355895:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839001 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355900:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636773.355903:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839001 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355908:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839001 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355915:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cf015d06900) 00010000:00010000:1.0:1788636773.355918:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636773.355920:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839001 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355926:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839001 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355940:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.355947:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.356146:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.356158:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636773.356161:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.356167:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.356176:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:1.0:1788636773.356179:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636773.356182:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.356188:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839008 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636773.357421:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+35:12413:x1875521207106432:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 2630us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636773.357433:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 210 00000100:00100000:2.0:1788636773.415749:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636773.415916:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207106688 00000100:00100000:1.0:1788636773.415930:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207106688 00000100:00100000:1.0:1788636773.416000:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 211 00000100:00100000:1.0:1788636773.416012:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00315cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+35:12416:x1875521207106688:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636773.416037:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636773.416061:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e83900f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392b5 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416154:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839016 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416201:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839016 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416226:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839016 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416245:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e83901d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416254:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e83901d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416277:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e83901d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416404:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839024 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416416:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416423:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839024 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636773.416435:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788636773.416520:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839016 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416527:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839016 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416533:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416545:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636773.416549:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839016 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416556:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839016 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416568:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:1.0:1788636773.416571:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636773.416576:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839016 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416583:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839016 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416597:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e83901d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416603:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e83901d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416608:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e83901d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416613:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636773.416615:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e83901d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416621:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e83901d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416639:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cf015d06900) 00010000:00010000:1.0:1788636773.416641:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636773.416644:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e83901d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416650:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e83901d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416692:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e83900f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392b5 expref: 38 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.416706:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839024 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392b5 expref: 37 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.417141:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:1.0:1788636773.417144:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788636773.417147:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36c00, rc 0) 00000100:00100000:1.0:1788636773.417263:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00315cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:12416:x1875521207106688:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1252us (1523us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788636773.417272:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 211 00000100:00100000:2.0:1788636773.425639:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636773.425731:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207106816 00000100:00100000:1.0:1788636773.425741:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207106816 00000100:00100000:1.0:1788636773.425800:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 212 00000100:00100000:1.0:1788636773.425852:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:12416:x1875521207106816:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:1.0:1788636773.425921:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.425937:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39299 expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.425971:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.426004:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39299 expref: 37 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636773.426018:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39299 expref: 37 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636773.426032:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226044544:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636773.426112:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef020330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636773.430024:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636773.430115:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207107072 00000100:00100000:3.0:1788636773.430126:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207107072 00000100:00100000:3.0:1788636773.430191:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:3.0:1788636773.430204:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:6171:x1875521207107072:12345-192.168.202.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788636773.430550:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+39:6171:x1875521207107072:12345-192.168.202.26@tcp:35:ldlm_bl.0 Request processed in 347us (534us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788636773.430557:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:1.0:1788636773.431298:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226044544:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636773.431341:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636773.434852:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636773.435104:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207107200 00000100:00100000:0.0:1788636773.435115:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207107200 00010000:00010000:0.0:1788636773.435158:0:14670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39299 expref: 39 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636773.435205:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 95 00000100:00100000:0.0:1788636773.435228:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+39:2400:x1875521207107200:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636773.435244:0:14670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636773.435251:0:14670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39299 expref: 39 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.435278:0:14670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39299 expref: 39 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.435302:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e838fc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39299 expref: 39 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.435332:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:0.0:1788636773.435339:0:14670:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.435349:0:14670:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.435358:0:14670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.435393:0:14670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636773.435459:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:2400:x1875521207107200:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 233us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.435466:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 95 00010000:00010000:3.0:1788636773.436144:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.436164:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.436204:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.436223:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.436231:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.436236:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636773.436241:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.436250:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.436263:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:3.0:1788636773.436266:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636773.436272:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.436278:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e839032 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636773.436411:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:12416:x1875521207106816:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 10599us (10780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636773.436421:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 212 00000100:00100000:2.0:1788636773.441143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636773.441403:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207107456 00000100:00100000:3.0:1788636773.441413:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207107456 00000100:00100000:3.0:1788636773.441471:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 53 00000100:00100000:3.0:1788636773.441483:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+37:12416:x1875521207107456:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636773.441718:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:12416:x1875521207107456:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 237us (586us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788636773.441727:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 53 00000100:00100000:1.0:1788636773.525135:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636773.525166:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226044672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636773.525274:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636773.525629:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226044672 00000100:00100000:3.0:1788636773.525638:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226044672 00000100:00100000:3.0:1788636773.525702:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788636773.525712:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226044672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788636773.525743:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788636773.525794:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226044672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636773.525801:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788636773.525871:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226044672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636773.525986:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636773.525997:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226044800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636773.526027:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788636773.526096:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636773.526108:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226044800 00000100:00100000:1.0:1788636773.526111:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226044800 00000100:00100000:1.0:1788636773.526147:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788636773.526153:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226044800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636773.526164:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788636773.526192:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226044800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636773.526225:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:2.0:1788636773.526341:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636773.526364:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226044800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636773.526785:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226044928:0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.526839:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636773.526874:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226045440:0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.526901:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636773.526931:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226045952:0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.526966:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636773.526988:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788636773.526993:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226045312:0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.527018:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636773.527039:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226045824:0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.527058:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636773.527084:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226045440 00000100:00100000:2.0:1788636773.527089:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226045440 00000100:00100000:2.0:1788636773.527124:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788636773.527130:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226045440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.527171:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226045440:12345-0@lo:400:kworker.0 Request processed in 41us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636773.527178:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788636773.527198:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226045952 00000100:00100000:2.0:1788636773.527201:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226045952 00000100:00100000:2.0:1788636773.527241:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226045824 00000100:00100000:2.0:1788636773.527244:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226045824 00000100:00100000:2.0:1788636773.527261:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788636773.527267:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226045952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.527296:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226045952:12345-0@lo:400:kworker.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636773.527303:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788636773.527324:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788636773.527331:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226045824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.527356:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226045824:12345-0@lo:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636773.527370:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1788636773.527394:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636773.527415:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226045824:0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.527425:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226045440:0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.527433:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1788636773.527438:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1788636773.527452:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf03fcc0380, transno 4294967308 00000100:00100000:2.0:1788636773.527461:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226045952:0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.527482:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226045312 00000100:00100000:2.0:1788636773.527486:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226045312 00000100:00100000:2.0:1788636773.527511:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788636773.527518:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226045312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.527549:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226045312:12345-0@lo:400:kworker.0 Request processed in 31us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636773.527555:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788636773.527575:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226045312:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.527977:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226045184:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528009:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636773.528026:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226045696:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528044:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636773.528067:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226046208:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528084:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636773.528108:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788636773.528114:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226045056:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528132:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636773.528143:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521226045568:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528158:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636773.528168:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521226046080:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528182:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636773.528198:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226045696 00000100:00100000:0.0:1788636773.528202:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226045696 00000100:00100000:0.0:1788636773.528239:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226046208 00000100:00100000:0.0:1788636773.528242:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226046208 00000100:00100000:0.0:1788636773.528253:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226045056 00000100:00100000:0.0:1788636773.528255:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226045056 00000100:00100000:0.0:1788636773.528264:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226045568 00000100:00100000:0.0:1788636773.528266:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226045568 00000100:00100000:0.0:1788636773.528275:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226046080 00000100:00100000:0.0:1788636773.528276:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226046080 00000100:00100000:0.0:1788636773.528288:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788636773.528293:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226045696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528335:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226045696:12345-0@lo:400:kworker.0 Request processed in 41us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.528341:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788636773.528352:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788636773.528357:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226046208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528378:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226046208:12345-0@lo:400:kworker.0 Request processed in 21us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.528384:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788636773.528394:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788636773.528407:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226045056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528435:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226045056:12345-0@lo:400:kworker.0 Request processed in 29us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.528440:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788636773.528452:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788636773.528458:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521226045568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528483:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521226045568:12345-0@lo:400:kworker.0 Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.528488:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788636773.528499:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788636773.528504:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521226046080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528527:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521226046080:12345-0@lo:400:kworker.0 Request processed in 24us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.528533:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00080000:0.0:1788636773.528548:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636773.528552:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636773.528573:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226045056:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528583:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521226045568:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.528592:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521226046080:0@lo:400:kworker.0 00010000:00080000:0.0:1788636773.528604:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fccca80 x1875521226045696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636773.528613:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226045696:0@lo:400:kworker.0 00010000:00080000:0.0:1788636773.528622:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fccf480 x1875521226046208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636773.528641:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226046208:0@lo:400:kworker.0 00000100:00100000:1.0:1788636773.530160:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226044928 00000100:00100000:1.0:1788636773.530174:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226044928 00000100:00100000:1.0:1788636773.530248:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1788636773.530258:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226044928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636773.530356:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226044928:12345-0@lo:400:kworker.0 Request processed in 100us (3516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636773.530364:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788636773.532499:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226045184 00000100:00100000:2.0:1788636773.532519:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226045184 00000100:00100000:2.0:1788636773.532610:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788636773.532623:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226045184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636773.532766:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226045184:12345-0@lo:400:kworker.0 Request processed in 144us (4754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636773.532774:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788636773.533330:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226045184:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.533493:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226044928:0@lo:400:kworker.0 00000100:00100000:0.0:1788636773.611022:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636773.611261:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207107712 00000100:00100000:2.0:1788636773.611289:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207107712 00000100:00100000:2.0:1788636773.611356:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 213 00000100:00100000:2.0:1788636773.611370:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+38:12427:x1875521207107712:12345-192.168.202.26@tcp:101:cat.0 00010000:00010000:2.0:1788636773.611400:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636773.611424:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839039 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392bc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611515:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e839040 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611532:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e839040 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611544:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e839040 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611558:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839047 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611566:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839047 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611572:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839047 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611692:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83904e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611701:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83904e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611718:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83904e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636773.611734:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788636773.611851:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e839040 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611859:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e839040 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611867:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e839040 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.611873:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636773.611877:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e839040 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612058:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e839040 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612072:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:2.0:1788636773.612075:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636773.612080:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e839040 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612086:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e839040 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612105:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839047 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612112:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839047 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612128:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839047 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612134:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636773.612137:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839047 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612144:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839047 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612151:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636773.612154:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636773.612157:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839047 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612162:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839047 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612206:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839039 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392bc expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612232:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83904e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392bc expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.612239:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:2.0:1788636773.612241:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636773.612243:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1000, rc 0) 00000100:00100000:2.0:1788636773.612373:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+40:12427:x1875521207107712:12345-192.168.202.26@tcp:101:cat.0 Request processed in 1006us (1366us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788636773.612390:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 213 00000100:00100000:2.0:1788636773.621774:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636773.621874:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207107968 00000100:00100000:3.0:1788636773.621884:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207107968 00000100:00100000:3.0:1788636773.622073:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00100000:3.0:1788636773.622085:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+40:12427:x1875521207107968:12345-192.168.202.26@tcp:35:cat.0 00000100:00100000:3.0:1788636773.622490:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+41:12427:x1875521207107968:12345-192.168.202.26@tcp:35:cat.0 Request processed in 406us (786us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788636773.622498:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00100000:1.0:1788636773.674976:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636773.675084:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207108224 00000100:00100000:3.0:1788636773.675094:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207108224 00000100:00100000:3.0:1788636773.675156:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 214 00000100:00100000:3.0:1788636773.675180:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+41:12428:x1875521207108224:12345-192.168.202.26@tcp:36:rm.0 00010000:00010000:3.0:1788636773.675251:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788636773.675292:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e838fec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392a7 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675327:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83904e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392bc expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675343:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839024 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392b5 expref: 39 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675356:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e838fde lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392a0 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675367:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:3.0:1788636773.675373:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636773.675394:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83905c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675409:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83905c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675419:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83905c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675434:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675440:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675454:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675541:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83906a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675549:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83906a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.675556:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83906a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636773.676191:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788636773.676204:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 442487396285ns, next at 443487393565ns, rc = 0 00010000:00010000:3.0:1788636773.676380:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.676392:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.676400:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.676407:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.676414:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.676420:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.676462:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636773.676990:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83906a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.676999:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83906a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677006:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83906a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677011:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636773.677016:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83906a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677023:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83906a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677036:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:3.0:1788636773.677040:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788636773.677045:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83906a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677052:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83906a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677073:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83905c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677079:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83905c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677085:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83905c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677098:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636773.677101:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83905c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677107:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83905c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677115:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:3.0:1788636773.677117:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636773.677120:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83905c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677126:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e83905c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636773.677138:0:6523:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000864074c9 reply state 00000000b7b17445 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677149:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636773.677156:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217ac00) 00010000:00010000:3.0:1788636773.677158:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788636773.677161:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636773.677259:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+39:12428:x1875521207108224:12345-192.168.202.26@tcp:36:rm.0 Request processed in 2077us (2289us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788636773.678164:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 214 00010000:00010000:2.0:1788636773.678511:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636773.678520:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.678528:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636773.678532:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.678541:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.678555:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:2.0:1788636773.678558:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788636773.678562:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.678568:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839071 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.678593:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636773.678595:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636773.678597:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636773.771658:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636773.771899:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207108480 00000100:00100000:2.0:1788636773.771911:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207108480 00000100:00100000:2.0:1788636773.771982:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 215 00000100:00100000:2.0:1788636773.771993:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+39:12434:x1875521207108480:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636773.772016:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636773.772051:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839078 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392c3 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772160:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e83907f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772176:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e83907f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772188:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e83907f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772202:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772224:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772232:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636773.772555:0:11089:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788636773.772706:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772715:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772722:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772752:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e83907f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772783:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e83907f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772789:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e83907f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772795:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636773.772799:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e83907f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772861:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e83907f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772875:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:2.0:1788636773.772878:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636773.772883:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e83907f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772889:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1e00/0x5b741ef42e83907f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636773.772904:0:11089:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051bc066b reply state 0000000041695e20 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772914:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772921:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217ac00) 00010000:00010000:2.0:1788636773.772923:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788636773.772925:0:11089:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788636773.772955:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e839078 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392c3 expref: 42 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772977:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392c3 expref: 41 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.772984:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636773.772987:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636773.772989:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1000, rc 0) 00000100:00100000:2.0:1788636773.773051:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+42:12434:x1875521207108480:12345-192.168.202.26@tcp:101:bash.0 Request processed in 1060us (1405us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788636773.773060:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 215 00010000:00010000:2.0:1788636773.781151:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636773.783317:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636773.783425:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207108608 00000100:00100000:0.0:1788636773.783438:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207108608 00000100:00100000:0.0:1788636773.783504:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:0.0:1788636773.783514:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207108608:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:0.0:1788636773.783537:0:9845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636773.783562:0:9845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e83909b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392ca expref: -99 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788636773.783598:0:9845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788636773.783617:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1788636773.783622:0:9845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636773.783631:0:9845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e83909b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ca expref: 6 pid: 9845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.783651:0:9845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e83909b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ca expref: 6 pid: 9845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.783664:0:9845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6c00, rc 0) 00000100:00100000:0.0:1788636773.783742:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207108608:12345-192.168.202.26@tcp:101:bash.0 Request processed in 229us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.783774:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:1.0:1788636773.790184:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636773.790298:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207108736 00000100:00100000:2.0:1788636773.790320:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207108736 00000100:00100000:2.0:1788636773.790390:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 68 00000100:00100000:2.0:1788636773.790401:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:12434:x1875521207108736:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636773.790423:0:9847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636773.790444:0:9847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392d1 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.790479:0:9847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e83909b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ca expref: 7 pid: 9845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.790489:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636773.790493:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636773.790500:0:9847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 7 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.790548:0:9847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e83909b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ca expref: 7 pid: 9845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.790563:0:9847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e83909b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ca expref: 7 pid: 9845 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636773.790594:0:9847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9847:1875521226046336:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636773.790707:0:9847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aaae180 going to sleep for 11 seconds 00000100:00100000:1.0:1788636773.802897:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636773.803263:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207108864 00000100:00100000:0.0:1788636773.803274:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207108864 00010000:00010000:0.0:1788636773.803336:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e83909b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ca expref: 8 pid: 9845 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636773.803394:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 96 00000100:00100000:0.0:1788636773.803406:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2400:x1875521207108864:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636773.803424:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636773.803453:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e83909b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ca expref: 8 pid: 9845 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.803469:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e83909b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ca expref: 8 pid: 9845 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.803500:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636773.803506:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636773.803518:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 8 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.803530:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 8 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636773.803589:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 8 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636773.803627:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1875521226046464:192.168.202.26@tcp:105: 00000100:00100000:0.0:1788636773.804621:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10780 going to sleep for 11 seconds 00010000:00010000:2.0:1788636773.805143:0:9847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000208deb0/0x5b741ef42e83909b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ca expref: 8 pid: 9845 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636773.805164:0:9847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03657800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9847:1875521226046336:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636773.805191:0:9847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 7 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636773.805218:0:9847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0400, rc 0) 00000100:00100000:2.0:1788636773.805283:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:12434:x1875521207108736:12345-192.168.202.26@tcp:101:bash.0 Request processed in 14883us (15108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636773.805292:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 68 00000100:00100000:0.0:1788636773.814255:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1875521226046464:192.168.202.26@tcp:105: 00010000:00010000:0.0:1788636773.814285:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636773.814356:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207108864:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 10951us (11471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636773.814368:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 96 00000100:00100000:3.0:1788636773.818421:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636773.818690:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207109120 00000100:00100000:1.0:1788636773.818701:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207109120 00000100:00100000:1.0:1788636773.818777:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00100000:1.0:1788636773.818787:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+42:12434:x1875521207109120:12345-192.168.202.26@tcp:35:bash.0 00000100:00100000:1.0:1788636773.819133:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+43:12434:x1875521207109120:12345-192.168.202.26@tcp:35:bash.0 Request processed in 346us (721us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788636773.819142:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00100000:1.0:1788636774.020605:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.020866:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207109248 00000100:00100000:0.0:1788636774.020878:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207109248 00002000:00100000:0.0:1788636774.020960:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9cf03fccc000 x1875521207109248/t0(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:260/0 lens 504/0 e 0 to 0 dl 1788636785 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636774.020971:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf03fccc000 with x1875521207109248 ext(0->8) 00002000:00010000:0.0:1788636774.020978:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf03fccc000 00000100:00100000:0.0:1788636774.021017:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:0.0:1788636774.021029:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2398:x1875521207109248:12345-192.168.202.26@tcp:4:bash.0 00000100:00080000:2.0:1788636774.022302:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636774.023052:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2398:x1875521207109248:12345-192.168.202.26@tcp:4:bash.0 Request processed in 2018us (2449us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788636774.023065:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 6 00002000:00100000:0.0:1788636774.023077:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9cf03fccc000 x1875521207109248/t4294967309(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:260/0 lens 504/448 e 0 to 0 dl 1788636785 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636774.023086:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf03fccc000 with x1875521207109248 ext(0->8) 00002000:00010000:0.0:1788636774.023093:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf03fccc000 00000100:00100000:3.0:1788636774.028729:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.033858:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207109376 00000100:00100000:1.0:1788636774.033874:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207109376 00000100:00100000:1.0:1788636774.033949:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:1.0:1788636774.033959:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2399:x1875521207109376:12345-192.168.202.26@tcp:16:kworker.0 00000001:00080000:2.0:1788636774.045966:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1788636774.046280:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2399:x1875521207109376:12345-192.168.202.26@tcp:16:kworker.0 Request processed in 12315us (17554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.046307:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:3.0:1788636774.088927:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.089716:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207109504 00000100:00100000:0.0:1788636774.089729:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207109504 00000100:00080000:2.0:1788636774.089964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636774.090292:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 216 00000100:00100000:1.0:1788636774.090305:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+43:12450:x1875521207109504:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636774.090339:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636774.090361:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e8390a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392d8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.090427:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e8390b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.090442:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e8390b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.090454:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e8390b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636774.090502:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788636774.090506:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788636774.090525:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e8390b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.090550:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e8390a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d8 expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.090570:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e8390b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d8 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.090578:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:1.0:1788636774.090593:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636774.090597:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36600, rc 0) 00000100:00100000:1.0:1788636774.090667:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+44:12450:x1875521207109504:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 364us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.090675:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 216 00000100:00100000:2.0:1788636774.096571:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.096666:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207109760 00000100:00100000:3.0:1788636774.096680:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207109760 00000100:00100000:3.0:1788636774.096742:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 217 00000100:00100000:3.0:1788636774.096761:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+44:12450:x1875521207109760:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636774.096782:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636774.096803:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8390b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392df expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.097096:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e8390be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.097112:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e8390be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.097124:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e8390be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636774.097135:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788636774.097253:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8390b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392df expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.098187:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e8390be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392df expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.098200:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:3.0:1788636774.098203:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636774.098217:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9200, rc 0) 00000100:00100000:2.0:1788636774.098448:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+46:12450:x1875521207109760:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1694us (1885us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788636774.098472:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 217 00000100:00100000:0.0:1788636774.103463:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.103595:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.103906:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207110144 00000100:00100000:1.0:1788636774.103919:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207110144 00000100:00100000:1.0:1788636774.103986:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 218 00000100:00100000:1.0:1788636774.103997:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+46:12450:x1875521207110144:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636774.104023:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636774.104045:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e8390cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392e6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.104142:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8390d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.104157:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8390d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.104169:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8390d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636774.104180:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788636774.104301:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e8390cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392e6 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.104328:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8390d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392e6 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.104356:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:1.0:1788636774.104359:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788636774.104363:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37a00, rc 0) 00000100:00100000:1.0:1788636774.104428:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+48:12450:x1875521207110144:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 432us (832us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788636774.104436:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 218 00000100:00100000:0.0:1788636774.109620:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.109834:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207110272 00000100:00100000:1.0:1788636774.109845:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207110272 00000100:00100000:1.0:1788636774.109895:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:1.0:1788636774.109906:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2400:x1875521207110272:12345-192.168.202.26@tcp:1:lfs.0 00010000:00010000:1.0:1788636774.109967:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.109989:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 6 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.109998:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636774.110002:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636774.110007:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.110043:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 6 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.110058:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 6 pid: 9847 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.110086:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875521226046592:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636774.110167:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636774.111069:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207109888 00000100:00100000:2.0:1788636774.111078:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207109888 00000100:00100000:2.0:1788636774.111131:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:2.0:1788636774.111140:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+48:2401:x1875521207109888:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636774.111152:0:14670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636774.111173:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e8390be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392df expref: 48 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.111192:0:14670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636774.111197:0:14670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636774.111245:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+47:2401:x1875521207109888:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 105us (7791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.111252:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:1.0:1788636774.117165:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1875521226046592:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636774.117195:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.118659:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.118765:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207110400 00000100:00100000:2.0:1788636774.118775:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207110400 00010000:00010000:2.0:1788636774.118844:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 7 pid: 9847 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636774.118876:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 97 00000100:00100000:2.0:1788636774.118886:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207110400:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636774.118900:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788636774.118919:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788636774.118922:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788636774 00002000:00010000:2.0:1788636774.118925:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788636774 00002000:00010000:2.0:1788636774.118943:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788636774.118961:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 7 pid: 9847 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.118978:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 7 pid: 9847 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.119004:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000422ab205/0x5b741ef42e8390a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d1 expref: 7 pid: 9847 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.119020:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636774.119025:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636774.119031:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.119042:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.119075:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636774.119134:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+6:2401:x1875521207110400:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 249us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.119142:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 97 00010000:00010000:1.0:1788636774.119507:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.119518:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.119537:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.119545:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.119553:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.119560:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636774.119564:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.119587:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.119599:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.119607:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f38e10d/0x5b741ef42e8390e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.119668:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207110272:12345-192.168.202.26@tcp:1:lfs.0 Request processed in 9763us (10060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.119677:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:3.0:1788636774.124857:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.124970:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207110656 00000100:00100000:1.0:1788636774.124981:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207110656 00000100:00100000:1.0:1788636774.125036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 56 00000100:00100000:1.0:1788636774.125046:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+47:12450:x1875521207110656:12345-192.168.202.26@tcp:35:lfs.0 00000004:00010000:1.0:1788636774.125108:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8390d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392e6 expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636774.125306:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1788636774.125352:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788636774.125616:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1788636774.125654:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.125669:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392c3 expref: 51 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.125695:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.125730:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392c3 expref: 51 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.125744:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392c3 expref: 51 pid: 11089 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.125758:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1875521226046720:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636774.125882:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00944e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636774.134885:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.134984:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207110784 00000100:00100000:2.0:1788636774.134994:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207110784 00010000:00010000:2.0:1788636774.135034:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392c3 expref: 52 pid: 11089 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636774.135074:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 98 00000100:00100000:2.0:1788636774.135095:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+52:2400:x1875521207110784:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636774.135110:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636774.135117:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392c3 expref: 52 pid: 11089 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.135131:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392c3 expref: 52 pid: 11089 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.135153:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:2.0:1788636774.135158:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.135169:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.135177:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.135196:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636774.135262:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+52:2400:x1875521207110784:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 168us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.135270:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 98 00010000:00010000:1.0:1788636774.136662:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83908d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392c3 expref: 51 pid: 11089 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.136687:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1875521226046720:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636774.136711:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.136722:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.136727:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636774.136906:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1788636774.137256:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788636774.137508:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1875521226046848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788636774.137597:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636774.137699:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf007de4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636774.138944:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226046848 00000100:00100000:2.0:1788636774.139031:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226046848 00000100:00100000:0.0:1788636774.139252:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788636774.139419:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1875521226046848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788636774.139602:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1875521226046848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 340us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636774.139611:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788636774.139698:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1875521226046848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788636774.140082:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788636774.140160:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1875521226046976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788636774.140203:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636774.140624:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026acb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636774.140784:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226046976 00000100:00100000:0.0:1788636774.140792:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226046976 00000100:00100000:0.0:1788636774.140863:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788636774.140872:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6525:x1875521226046976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788636774.141026:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6525:x1875521226046976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 155us (822us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788636774.141034:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788636774.141536:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1875521226046976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788636774.141597:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788636774.141642:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.141653:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.141660:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.141666:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636774.141671:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.141679:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.141694:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:1.0:1788636774.141697:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788636774.141701:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.141725:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e8390e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788636774.141855:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788636774.141914:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788636774.141925:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 442953117436ns, next at 443953115236ns, rc = 0 00000001:00080000:1.0:1788636774.141932:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788636774.141968:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf03a5ecb00) 00010000:00010000:1.0:1788636774.141971:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788636774.141979:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8390d3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392e6 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.142083:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+54:12450:x1875521207110656:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 17038us (17277us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788636774.142092:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 56 00000020:00080000:1.0:1788636774.142096:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788636774.145921:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.146074:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207110912 00000100:00100000:1.0:1788636774.146083:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207110912 00000100:00100000:1.0:1788636774.146183:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 219 00000100:00100000:1.0:1788636774.146194:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+54:12450:x1875521207110912:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636774.146231:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636774.146253:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e8390ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392ed expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.146619:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e8390ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ed expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.146654:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e8390ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ed expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.146676:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:1.0:1788636774.146680:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636774.146684:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36e00, rc 0) 00000100:00100000:1.0:1788636774.146798:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:12450:x1875521207110912:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 605us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.146834:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 219 00000100:00100000:0.0:1788636774.150615:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.150722:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207111168 00000100:00100000:2.0:1788636774.150733:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207111168 00000100:00100000:2.0:1788636774.150909:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:2.0:1788636774.150921:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+55:12450:x1875521207111168:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:2.0:1788636774.151544:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+56:12450:x1875521207111168:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 622us (936us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788636774.151567:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:3.0:1788636774.284230:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.284445:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207111296 00000100:00100000:2.0:1788636774.284455:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207111296 00000100:00100000:2.0:1788636774.284522:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 220 00000100:00100000:2.0:1788636774.284533:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+56:12460:x1875521207111296:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:2.0:1788636774.284737:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8390f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.284755:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8390f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.284932:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8390f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285014:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8390fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285024:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8390fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285030:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8390fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285102:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285111:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285118:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636774.285174:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285187:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8390f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285193:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8390f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285199:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8390f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285217:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636774.285222:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8390f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285229:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8390f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285241:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:2.0:1788636774.285244:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636774.285248:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8390f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285255:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8390f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285270:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8390fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285275:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8390fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285287:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8390fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285292:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636774.285295:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8390fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285301:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8390fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285473:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217ac00) 00010000:00010000:2.0:1788636774.285477:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636774.285481:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8390fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285488:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1c00/0x5b741ef42e8390fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285502:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285508:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285515:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285521:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636774.285524:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285541:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285550:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:2.0:1788636774.285553:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636774.285556:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.285563:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839104 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636774.285880:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+56:12460:x1875521207111296:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 1346us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.285890:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 220 00000100:00100000:0.0:1788636774.364051:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.364198:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207111552 00000100:00100000:3.0:1788636774.364218:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207111552 00000100:00100000:3.0:1788636774.364289:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 221 00000100:00100000:3.0:1788636774.364301:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+56:12463:x1875521207111552:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636774.364331:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636774.364355:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e83910b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392f4 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364433:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839112 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364449:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839112 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364462:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839112 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364474:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e839119 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364483:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e839119 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364489:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e839119 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364624:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839120 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364633:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364658:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839120 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636774.364669:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788636774.364746:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839112 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364754:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839112 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364760:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839112 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364766:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.364770:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839112 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364777:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839112 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364789:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:3.0:1788636774.364792:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.364796:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839112 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364802:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839112 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364855:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e839119 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364861:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e839119 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364875:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e839119 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364880:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.364883:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e839119 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364888:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e839119 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364896:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217ac00) 00010000:00010000:3.0:1788636774.364898:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.364901:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e839119 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364906:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e839119 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364939:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e83910b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392f4 expref: 59 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364964:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839120 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392f4 expref: 58 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.364971:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:3.0:1788636774.364973:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636774.364975:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9c00, rc 0) 00000100:00100000:3.0:1788636774.365033:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12463:x1875521207111552:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 735us (993us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788636774.365048:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 221 00000100:00100000:0.0:1788636774.371558:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.371763:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207111680 00000100:00100000:1.0:1788636774.371774:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207111680 00000100:00100000:1.0:1788636774.371868:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 222 00000100:00100000:1.0:1788636774.371879:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12463:x1875521207111680:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:1.0:1788636774.371965:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e83912e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.371983:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e83912e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.371996:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e83912e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.372033:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e83912e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.372040:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e83912e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.372062:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e83912e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.372068:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636774.372072:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e83912e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.372080:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e83912e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.372091:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:1.0:1788636774.372094:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636774.372099:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e83912e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.372105:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e83912e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.372194:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12463:x1875521207111680:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 315us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.372202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 222 00000100:00100000:0.0:1788636774.378980:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.379082:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207111936 00000100:00100000:3.0:1788636774.379093:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207111936 00000100:00100000:3.0:1788636774.379157:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00100000:3.0:1788636774.379169:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+58:12463:x1875521207111936:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:3.0:1788636774.379466:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+59:12463:x1875521207111936:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 298us (495us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788636774.379475:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00100000:2.0:1788636774.513490:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.513625:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207112192 00000100:00100000:3.0:1788636774.513636:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207112192 00000100:00100000:3.0:1788636774.513711:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 223 00000100:00100000:3.0:1788636774.513722:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+59:12473:x1875521207112192:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636774.513745:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636774.513749:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788636774.513786:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36600/0x5b741ef42e8390b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392d8 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.513864:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:3.0:1788636774.513871:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636774.513887:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839135 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef392fb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.514013:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e83913c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.514028:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e83913c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.514064:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e83913c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636774.514077:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788636774.514191:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839135 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392fb expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.514240:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e83913c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392fb expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.514248:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:3.0:1788636774.514251:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636774.514253:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9800, rc 0) 00000100:00100000:3.0:1788636774.514329:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:12473:x1875521207112192:12345-192.168.202.26@tcp:101:bash.0 Request processed in 608us (850us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788636774.514337:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 223 00000100:00100000:0.0:1788636774.517214:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.517320:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207112320 00000100:00100000:2.0:1788636774.517337:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207112320 00000100:00100000:2.0:1788636774.517411:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 224 00000100:00100000:2.0:1788636774.517423:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:12473:x1875521207112320:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636774.517445:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636774.517466:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83914a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39302 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.517500:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.517515:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.517545:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.517674:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e83914a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39302 expref: 62 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.517693:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39302 expref: 61 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.517703:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:2.0:1788636774.517706:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788636774.517710:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1a00, rc 0) 00000100:00100000:2.0:1788636774.517781:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:12473:x1875521207112320:12345-192.168.202.26@tcp:101:bash.0 Request processed in 361us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.517788:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 224 00000100:00100000:2.0:1788636774.521892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.523248:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207112448 00000100:00100000:3.0:1788636774.523281:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207112448 00000100:00100000:3.0:1788636774.523401:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:3.0:1788636774.523417:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+61:2401:x1875521207112448:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636774.523443:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636774.523478:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e83913c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392fb expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.523504:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:3.0:1788636774.523511:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636774.523610:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:2401:x1875521207112448:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 198us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636774.523620:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:0.0:1788636774.531986:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.532109:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207112704 00000100:00100000:1.0:1788636774.532131:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207112704 00000100:00100000:1.0:1788636774.532218:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 225 00000100:00100000:1.0:1788636774.532231:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+60:12473:x1875521207112704:12345-192.168.202.26@tcp:36:bash.0 00010000:00010000:1.0:1788636774.532327:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636774.532360:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839120 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392f4 expref: 60 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.532406:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:1.0:1788636774.532412:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636774.532635:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.532651:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.532662:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636774.532964:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1788636774.532988:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bba372a reply state 0000000046b88900 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.532999:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.533003:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:1.0:1788636774.533006:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788636774.533008:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636774.533110:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:12473:x1875521207112704:12345-192.168.202.26@tcp:36:bash.0 Request processed in 882us (1139us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788636774.533119:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 225 00000020:00080000:1.0:1788636774.533125:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788636774.538685:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.538852:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207112832 00000100:00100000:1.0:1788636774.538866:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207112832 00000100:00100000:1.0:1788636774.539003:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 226 00000100:00100000:1.0:1788636774.539017:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+62:12473:x1875521207112832:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:1.0:1788636774.539066:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636774.539094:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e83915f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39309 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.539243:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.539262:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.539276:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636774.539417:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788636774.539423:0:13298:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788636774.539451:0:13298:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.539545:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e83915f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39309 expref: 64 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.539569:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39309 expref: 63 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.539580:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:1.0:1788636774.539583:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636774.539587:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37400, rc 0) 00000100:00100000:1.0:1788636774.539667:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+63:12473:x1875521207112832:12345-192.168.202.26@tcp:101:bash.0 Request processed in 652us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.539676:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 226 00000100:00100000:3.0:1788636774.548696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.554456:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207113088 00000100:00100000:1.0:1788636774.554545:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207113088 00000100:00100000:1.0:1788636774.555020:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:1.0:1788636774.555035:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+63:12473:x1875521207113088:12345-192.168.202.26@tcp:35:bash.0 00000100:00100000:1.0:1788636774.555400:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+64:12473:x1875521207113088:12345-192.168.202.26@tcp:35:bash.0 Request processed in 367us (6718us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788636774.555409:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:0.0:1788636774.672795:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.673216:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207113216 00000100:00100000:1.0:1788636774.673235:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207113216 00000100:00100000:1.0:1788636774.673351:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 227 00000100:00100000:1.0:1788636774.673369:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+64:12479:x1875521207113216:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636774.673418:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636774.673472:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e83916d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39310 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.673586:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e839174 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.673610:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e839174 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.673641:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e839174 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636774.673984:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788636774.673990:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788636774.674020:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e839174 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.674054:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36400/0x5b741ef42e83916d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39310 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.674089:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e839174 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39310 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.674101:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:1.0:1788636774.674104:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636774.674108:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36a00, rc 0) 00000100:00100000:1.0:1788636774.674217:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+65:12479:x1875521207113216:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 844us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.674225:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 227 00000100:00100000:3.0:1788636774.678084:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.678243:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207113344 00000100:00100000:1.0:1788636774.678261:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207113344 00000100:00100000:1.0:1788636774.678349:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 228 00000100:00100000:1.0:1788636774.678364:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+65:12479:x1875521207113344:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636774.678401:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636774.678432:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83917b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39317 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.678667:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839182 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.678689:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839182 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.678770:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839182 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.678785:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e839189 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.678834:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e839189 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.678843:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e839189 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.678990:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e839190 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679002:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e839190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679009:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e839190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636774.679059:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788636774.679064:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788636774.679090:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e839190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679103:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e839190 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679114:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839182 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679122:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839182 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679129:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839182 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679146:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636774.679152:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839182 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679163:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839182 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679182:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:1.0:1788636774.679186:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636774.679192:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839182 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679200:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839182 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679229:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e839189 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679236:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e839189 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679243:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e839189 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679248:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636774.679252:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e839189 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679258:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e839189 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679280:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217ac00) 00010000:00010000:1.0:1788636774.679282:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636774.679286:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e839189 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.679293:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e839189 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.683831:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e83917b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39317 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.683878:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e839190 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39317 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.683890:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:1.0:1788636774.683893:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636774.683897:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37800, rc 0) 00000100:00100000:1.0:1788636774.684019:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:12479:x1875521207113344:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 5658us (5952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.684031:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 228 00000100:00100000:0.0:1788636774.691730:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.691988:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207113472 00000100:00100000:2.0:1788636774.692004:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207113472 00000100:00100000:2.0:1788636774.692090:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:2.0:1788636774.692105:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:2400:x1875521207113472:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636774.692132:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636774.692173:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37800/0x5b741ef42e839190 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39317 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.692202:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:2.0:1788636774.692221:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636774.692337:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+65:2400:x1875521207113472:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 235us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.692346:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:3.0:1788636774.695495:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.696161:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207113728 00000100:00100000:1.0:1788636774.696175:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207113728 00000100:00100000:1.0:1788636774.696355:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 229 00000100:00100000:1.0:1788636774.696370:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+65:12479:x1875521207113728:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636774.696411:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636774.696442:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839197 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3931e expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.696655:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.696685:0:13298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39309 expref: 66 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.696697:0:13298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.696755:0:13298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39309 expref: 66 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.696772:0:13298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39309 expref: 66 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.696789:0:13298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcce680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13298:1875521226047104:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636774.696954:0:13298:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026acb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636774.700611:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.700681:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207113856 00000100:00100000:2.0:1788636774.700694:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207113856 00010000:00010000:2.0:1788636774.700757:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39309 expref: 67 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636774.700832:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 99 00000100:00100000:2.0:1788636774.700847:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:2400:x1875521207113856:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636774.700867:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636774.700875:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39309 expref: 67 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.700892:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39309 expref: 67 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.700919:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:2.0:1788636774.700925:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.700939:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.700947:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.700972:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636774.701035:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:2400:x1875521207113856:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 193us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.701061:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 99 00010000:00010000:1.0:1788636774.702162:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e839166 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39309 expref: 66 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.702195:0:13298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcce680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13298:1875521226047104:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636774.702235:0:13298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.702249:0:13298:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.702349:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636774.702485:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788636774.703710:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e839197 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3931e expref: 67 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.704034:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3931e expref: 66 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.704047:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:1.0:1788636774.704050:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788636774.704054:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37e00, rc 0) 00000100:00100000:1.0:1788636774.704166:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:12479:x1875521207113728:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 7797us (8683us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788636774.704178:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 229 00000100:00100000:0.0:1788636774.710262:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.710363:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207114112 00000100:00100000:2.0:1788636774.710377:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207114112 00000100:00100000:2.0:1788636774.710476:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:2.0:1788636774.710490:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:12479:x1875521207114112:12345-192.168.202.26@tcp:103:lfs.0 00010000:00010000:2.0:1788636774.710512:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636774.710546:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e8390ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ed expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.710568:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:2.0:1788636774.710575:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636774.710650:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+65:12479:x1875521207114112:12345-192.168.202.26@tcp:103:lfs.0 Request processed in 163us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.710658:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:0.0:1788636774.715300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.715595:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207114240 00000100:00100000:3.0:1788636774.715609:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207114240 00000100:00100000:3.0:1788636774.715909:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 230 00000100:00100000:3.0:1788636774.715923:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+65:12479:x1875521207114240:12345-192.168.202.26@tcp:58:lfs.0 00010000:00010000:3.0:1788636774.716074:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.716098:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.716114:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636774.716253:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788636774.716357:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+65:12479:x1875521207114240:12345-192.168.202.26@tcp:58:lfs.0 Request processed in 437us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636774.716366:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 230 00000100:00100000:1.0:1788636774.720348:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.720407:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207114368 00000100:00100000:2.0:1788636774.720421:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207114368 00000100:00100000:2.0:1788636774.720500:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 231 00000100:00100000:2.0:1788636774.720516:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+65:12479:x1875521207114368:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:2.0:1788636774.720549:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636774.720582:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8391b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39325 expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.720670:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.720683:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8391b3 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39325 expref: 66 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.720784:0:11089:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.720802:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8391b3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39325 expref: 66 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.720878:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:2.0:1788636774.720882:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636774.720886:0:11089:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8391b3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39325 expref: 66 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.720898:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0600, rc 0) 00000100:00100000:2.0:1788636774.720989:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:12479:x1875521207114368:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 476us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.720998:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 231 00000040:00080000:3.0:1788636774.742407:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636774.742421:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636774.742468:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788636774.742477:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636774.742687:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226047232:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788636774.743331:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636774.746364:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226047232:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636774.748417:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.748653:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207114496 00000100:00100000:1.0:1788636774.748666:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207114496 00000100:00100000:1.0:1788636774.748747:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 232 00000100:00100000:1.0:1788636774.748766:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:12480:x1875521207114496:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788636774.748847:0:13298:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788636774.749006:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:12480:x1875521207114496:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 247us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.749015:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 232 00000100:00100000:1.0:1788636774.753093:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.753573:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207114624 00000100:00100000:3.0:1788636774.753588:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207114624 00000100:00100000:3.0:1788636774.753682:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 233 00000100:00100000:3.0:1788636774.753696:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:12480:x1875521207114624:12345-192.168.202.26@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788636774.753928:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8391ba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.753957:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8391ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.753974:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8391ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.753995:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8391c1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754003:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8391c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754009:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8391c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754041:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754052:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754058:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636774.754140:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788636774.754146:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636774.754166:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754180:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8391ba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754187:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8391ba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754196:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8391ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754202:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.754218:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8391ba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754229:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8391ba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754246:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:3.0:1788636774.754250:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.754257:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8391ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754265:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e8391ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754285:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8391c1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.754302:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8391c1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.756856:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8391c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.756866:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.756872:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8391c1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.756885:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8391c1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.756907:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9cef0217a900) 00010000:00010000:3.0:1788636774.756910:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.756915:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8391c1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.756924:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8391c1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.757015:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.757024:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.757030:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.757036:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.757067:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.757074:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.757084:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:3.0:1788636774.757087:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.757090:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.757097:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8391c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.757235:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:12480:x1875521207114624:12345-192.168.202.26@tcp:34:lhsmtool_posix.0 Request processed in 3534us (4154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636774.757249:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 233 00000100:00100000:3.0:1788636774.761733:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.762094:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207114880 00000100:00100000:2.0:1788636774.762112:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207114880 00000100:00100000:2.0:1788636774.762202:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 234 00000100:00100000:2.0:1788636774.762225:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+66:12480:x1875521207114880:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636774.762254:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636774.762285:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8391cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3932c expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.762589:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.762610:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.762652:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636774.762671:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788636774.762913:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.762922:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.762929:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.762936:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636774.762941:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.762952:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.762968:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:2.0:1788636774.762972:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788636774.762978:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.762986:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.763049:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8391cf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3932c expref: 68 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.763075:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:2.0:1788636774.763078:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636774.763083:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8391cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3932c expref: 68 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.763096:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1200, rc 0) 00000100:00100000:2.0:1788636774.763200:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:12480:x1875521207114880:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 977us (1493us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788636774.763222:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 234 00000100:00100000:3.0:1788636774.773053:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.783945:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207115008 00000100:00100000:0.0:1788636774.783970:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207115008 00000100:00100000:0.0:1788636774.784106:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 235 00000100:00100000:0.0:1788636774.784120:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:12480:x1875521207115008:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788636774.784183:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788636774.786042:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:12480:x1875521207115008:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 1902us (12982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636774.786062:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 235 00000100:00100000:3.0:1788636774.796156:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.796466:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207115264 00000100:00100000:2.0:1788636774.796480:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207115264 00000100:00100000:2.0:1788636774.796567:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 236 00000100:00100000:2.0:1788636774.796579:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:12480:x1875521207115264:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636774.796604:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636774.796608:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788636774.796643:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36a00/0x5b741ef42e839174 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39310 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.796667:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:2.0:1788636774.796674:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636774.796691:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8391e4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39333 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636774.797888:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788636774.798120:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.798160:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.798173:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.798267:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8391e4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39333 expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.798293:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39333 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.799373:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cf03a5ec200) 00010000:00010000:2.0:1788636774.799380:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636774.799386:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0400, rc 0) 00000100:00100000:3.0:1788636774.799593:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+68:12480:x1875521207115264:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 3009us (3446us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788636774.799604:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 236 00000100:00100000:3.0:1788636774.803935:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.804179:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207115520 00000100:00100000:1.0:1788636774.804194:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207115520 00000100:00100000:1.0:1788636774.804300:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 237 00000100:00100000:1.0:1788636774.804318:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+68:12480:x1875521207115520:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788636774.804403:0:13298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636774.804434:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8391eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39333 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804453:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cf03a5ec200) 00010000:00010000:1.0:1788636774.804477:0:13298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636774.804507:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e8391f9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804525:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e8391f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804537:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e8391f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804554:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839200 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x1d32bbf2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804560:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839200 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d32bbf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804564:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839200 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d32bbf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804616:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e8391f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804639:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e8391f9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804644:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e8391f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804648:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636774.804652:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e8391f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804658:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e8391f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804664:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:1.0:1788636774.804666:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636774.804670:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e8391f9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804674:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37400/0x5b741ef42e8391f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804681:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839200 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d32bbf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804685:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839200 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d32bbf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804688:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839200 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d32bbf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804692:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636774.804701:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839200 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d32bbf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804708:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839200 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d32bbf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804715:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x1d32bbf2 (ffff9cf015d06d00) 00010000:00010000:1.0:1788636774.804718:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636774.804721:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839200 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1d32bbf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.804727:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e839200 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1d32bbf2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.804870:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:12480:x1875521207115520:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 561us (946us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788636774.804879:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 237 00010000:00010000:3.0:1788636774.805947:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636774.806588:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.806651:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207115648 00000100:00100000:0.0:1788636774.806661:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207115648 00000100:00100000:0.0:1788636774.806717:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 238 00000100:00100000:0.0:1788636774.806728:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+67:12480:x1875521207115648:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636774.806748:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636774.806770:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e839207 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3933a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.806840:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.806855:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.806867:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.807002:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e839207 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3933a expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.807017:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3933a expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.807024:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:0.0:1788636774.807027:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788636774.807030:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6c00, rc 0) 00000100:00100000:0.0:1788636774.807082:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+68:12480:x1875521207115648:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 357us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636774.807087:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 238 00000100:00100000:2.0:1788636774.809840:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.810100:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207115904 00000100:00100000:0.0:1788636774.810114:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207115904 00000100:00100000:3.0:1788636774.810249:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 239 00000100:00100000:3.0:1788636774.810360:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+68:12480:x1875521207115904:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636774.810453:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.810552:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.810561:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636774.810775:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788636774.810788:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443621980768ns, next at 444621976813ns, rc = 0 00000004:00010000:3.0:1788636774.810927:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd34b847 reply state 000000008cdf2767 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.810939:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.810991:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:3.0:1788636774.810994:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788636774.810999:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636774.811139:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+70:12480:x1875521207115904:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 878us (1338us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788636774.811148:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 239 00000100:00100000:1.0:1788636774.814388:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.814524:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207116032 00000100:00100000:3.0:1788636774.814538:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207116032 00000100:00100000:3.0:1788636774.814611:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 240 00000100:00100000:3.0:1788636774.814624:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+70:12480:x1875521207116032:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636774.814659:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636774.814687:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83921c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39341 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.814789:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83921c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39341 expref: 71 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.814849:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83921c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39341 expref: 71 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.814873:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:3.0:1788636774.814877:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788636774.814883:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9c00, rc 0) 00000100:00100000:3.0:1788636774.814955:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+71:12480:x1875521207116032:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 333us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636774.814963:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 240 00000100:00100000:1.0:1788636774.817513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.817577:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207116160 00000100:00100000:2.0:1788636774.817591:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207116160 00000100:00080000:0.0:1788636774.817740:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636774.817903:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:2.0:1788636774.817917:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2400:x1875521207116160:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788636774.818214:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:2400:x1875521207116160:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 Request processed in 292us (707us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788636774.818222:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:2.0:1788636774.822447:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.822636:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207116416 00000100:00100000:3.0:1788636774.822651:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207116416 00000100:00100000:3.0:1788636774.822771:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:3.0:1788636774.822784:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+71:12480:x1875521207116416:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788636774.823127:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+72:12480:x1875521207116416:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 346us (695us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788636774.823134:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:1.0:1788636774.827431:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.827630:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207116672 00000100:00100000:3.0:1788636774.827644:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207116672 00000100:00100000:3.0:1788636774.827901:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 241 00000100:00100000:3.0:1788636774.827914:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+72:12480:x1875521207116672:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788636774.828065:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+72:12480:x1875521207116672:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 153us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636774.828094:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 241 00000100:00100000:2.0:1788636774.831213:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.831426:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207116800 00000100:00100000:3.0:1788636774.831439:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207116800 00000100:00100000:3.0:1788636774.831670:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 242 00000100:00100000:3.0:1788636774.831685:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+72:12480:x1875521207116800:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636774.831718:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636774.831749:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839223 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39348 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.831896:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83922a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.831915:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83922a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.831927:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83922a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636774.831993:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636774.832018:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83922a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.832046:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839223 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39348 expref: 74 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.832064:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83922a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39348 expref: 73 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.832071:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:3.0:1788636774.832092:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788636774.832097:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9200, rc 0) 00000100:00100000:3.0:1788636774.832180:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+73:12480:x1875521207116800:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 499us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636774.832189:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 242 00000100:00100000:2.0:1788636774.837771:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.839048:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207116928 00000100:00100000:1.0:1788636774.839063:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207116928 00000100:00100000:1.0:1788636774.839189:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 72 00000100:00100000:1.0:1788636774.839211:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+10:2401:x1875521207116928:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636774.839239:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636774.839273:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ba7f500/0x5b741ef42e839231 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3934f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636774.839340:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c6e67, blocks: 0x0 00010000:00010000:1.0:1788636774.839371:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788636774.839377:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636774.839389:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ba7f500/0x5b741ef42e839231 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3934f expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.839411:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ba7f500/0x5b741ef42e839231 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3934f expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.839427:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37400, rc 0) 00000100:00100000:1.0:1788636774.839518:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:2401:x1875521207116928:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 318us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.839526:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 72 00000100:00100000:1.0:1788636774.848052:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.848278:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207117184 00000100:00100000:3.0:1788636774.848293:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207117184 00000100:00100000:3.0:1788636774.848367:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 243 00000100:00100000:3.0:1788636774.848377:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+73:12480:x1875521207117184:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788636774.848523:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+73:12480:x1875521207117184:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 146us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636774.848532:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 243 00000100:00100000:2.0:1788636774.853038:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.853168:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207117312 00000100:00100000:0.0:1788636774.853183:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207117312 00000100:00100000:0.0:1788636774.853512:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 73 00000100:00100000:0.0:1788636774.853527:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:12480:x1875521207117312:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636774.853553:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636774.853581:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39356 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.853624:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ba7f500/0x5b741ef42e839231 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3934f expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.853646:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636774.853651:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636774.853657:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.853704:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ba7f500/0x5b741ef42e839231 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3934f expref: 12 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.853718:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ba7f500/0x5b741ef42e839231 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3934f expref: 12 pid: 8436 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636774.853735:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1875521226047360:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636774.854060:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636774.857130:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.857220:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207117440 00000100:00100000:3.0:1788636774.857236:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207117440 00010000:00010000:3.0:1788636774.857321:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ba7f500/0x5b741ef42e839231 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3934f expref: 13 pid: 8436 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.857371:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 100 00000100:00100000:3.0:1788636774.857382:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:2401:x1875521207117440:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636774.857400:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636774.857429:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ba7f500/0x5b741ef42e839231 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3934f expref: 13 pid: 8436 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.857447:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ba7f500/0x5b741ef42e839231 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3934f expref: 13 pid: 8436 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.857506:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636774.857511:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636774.857523:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.857536:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.857586:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.857604:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1875521226047488:192.168.202.26@tcp:105: 00000100:00100000:3.0:1788636774.857720:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0600 going to sleep for 11 seconds 00010000:00010000:0.0:1788636774.858317:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ba7f500/0x5b741ef42e839231 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3934f expref: 13 pid: 8436 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636774.858337:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1875521226047360:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636774.858369:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.858384:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7000, rc 0) 00000100:00100000:0.0:1788636774.858434:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+12:12480:x1875521207117312:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 4911us (5409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636774.858622:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 73 00000100:00100000:3.0:1788636774.860576:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1875521226047488:192.168.202.26@tcp:105: 00010000:00010000:3.0:1788636774.860615:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636774.860738:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:2401:x1875521207117440:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 3356us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636774.860751:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 100 00000100:00100000:1.0:1788636774.862587:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.862643:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207117568 00000100:00100000:0.0:1788636774.862657:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207117568 00002000:00100000:0.0:1788636774.862721:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9cf03fcce300 x1875521207117568/t0(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:260/0 lens 504/0 e 0 to 0 dl 1788636785 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636774.862730:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf03fcce300 with x1875521207117568 ext(0->12) 00002000:00010000:0.0:1788636774.862735:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cf03fcce300 00000100:00100000:0.0:1788636774.862767:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:0.0:1788636774.862779:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+11:2401:x1875521207117568:12345-192.168.202.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788636774.864849:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:2401:x1875521207117568:12345-192.168.202.26@tcp:4:lhsmtool_posix.0 Request processed in 2057us (2259us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788636774.864866:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 7 00002000:00100000:0.0:1788636774.864883:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9cf03fcce300 x1875521207117568/t4294967321(0) o4->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:260/0 lens 504/448 e 0 to 0 dl 1788636785 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636774.864894:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf03fcce300 with x1875521207117568 ext(0->12) 00002000:00010000:0.0:1788636774.864902:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cf03fcce300 00000100:00100000:1.0:1788636774.867586:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.867678:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207117696 00000100:00100000:3.0:1788636774.867692:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207117696 00000100:00100000:3.0:1788636774.867767:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 244 00000100:00100000:3.0:1788636774.867777:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+73:12480:x1875521207117696:12345-192.168.202.26@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788636774.869761:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1788636774.869780:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1788636774.869843:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788636774.869873:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf007de4cc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788636774.869879:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cef0340f800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cef02033840 00000020:00080000:2.0:1788636774.869883:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cef0340f600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cef037c0000 00000004:00080000:2.0:1788636774.869913:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788636774.869947:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf03aaaea80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788636774.869951:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf040916d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf03a61e000 00000020:00080000:2.0:1788636774.869954:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf040916f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cef04217600 00000020:00080000:2.0:1788636774.869967:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788636774.869993:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788636774.870074:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788636774.870268:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636774.870297:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226047616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788636774.870384:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636774.870441:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226047616 00000100:00100000:0.0:1788636774.870449:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226047616 00000100:00100000:0.0:1788636774.870497:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636774.870518:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226047616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788636774.870553:0:9847:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:0.0:1788636774.870604:0:9847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c6e66, atime: 0x0, ctime: 0x6a9c6e66, blocks: 0x8 00010000:00010000:0.0:1788636774.870613:0:9847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e83923f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.870633:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1788636774.870638:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636774.870646:0:9847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e83923f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.870664:0:9847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e83923f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.870675:0:9847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e83923f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.870690:0:9847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e83923f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.870708:0:9847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788636774.870875:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3649:x1875521226047616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 358us (490us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788636774.870882:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1788636774.870934:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf03fcc4000/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788636774.870940:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226047616:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788636774.871142:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636774.871151:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e83923f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.871161:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636774.871167:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e83923f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.871179:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e83923f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.871213:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e83923f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.871241:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082976e3d/0x5b741ef42e83923f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.871268:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636774.871271:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636774.871273:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636774.871781:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636774.871798:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226047872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788636774.871876:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636774.871921:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226047872 00000100:00100000:1.0:1788636774.871927:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226047872 00000100:00100000:1.0:1788636774.871971:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636774.871980:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875521226047872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788636774.872120:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788636774.872124:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788636775 00002000:00010000:1.0:1788636774.872135:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788636774.872138:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788636775 -> 1788636775 00002000:00010000:1.0:1788636774.872153:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788636774.872193:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1875521226047872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 214us (316us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788636774.872200:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788636774.872321:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636774.872333:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226047744:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788636774.872369:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636774.872481:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226047744 00000100:00100000:1.0:1788636774.872487:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226047744 00010000:00010000:3.0:1788636774.872676:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872698:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872705:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872711:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.872716:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872725:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872741:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9cf015d06c00) 00010000:00010000:3.0:1788636774.872745:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.872751:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872757:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e838f3d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872787:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872793:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872800:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872820:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.872833:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872840:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872849:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9cef0217a100) 00010000:00010000:3.0:1788636774.872852:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.872856:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872862:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37200/0x5b741ef42e838fe5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872883:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872890:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872896:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872901:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.872905:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872911:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872918:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217ac00) 00010000:00010000:3.0:1788636774.872920:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.872929:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872934:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8e00/0x5b741ef42e839063 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872949:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872955:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872961:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872966:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.872969:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872975:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872983:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef0217ac00) 00010000:00010000:3.0:1788636774.872986:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.872989:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.872996:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1400/0x5b741ef42e839086 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873015:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873031:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873037:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873042:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.873045:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873051:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873061:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:3.0:1788636774.873063:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.873066:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873073:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e839158 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873086:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873093:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873099:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873104:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.873114:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873122:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873131:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:3.0:1788636774.873134:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788636774.873138:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.873159:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839215 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.873334:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:12480:x1875521207117696:12345-192.168.202.26@tcp:44:lhsmtool_posix.0 Request processed in 5554us (5761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636774.873345:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 244 00000100:00100000:1.0:1788636774.873450:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788636774.873461:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1875521226047744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788636774.873484:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1788636774.873515:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.873535:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000015d83446/0x5b741ef42e838ff3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ae expref: 12 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.873545:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788636774.873550:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636774.873554:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.873591:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000015d83446/0x5b741ef42e838ff3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ae expref: 12 pid: 9845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.873607:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000015d83446/0x5b741ef42e838ff3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ae expref: 12 pid: 9845 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.873635:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002493100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875521226048000:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636774.873689:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026acb3c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788636774.876927:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf03fccce00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788636774.876951:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226047872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788636774.880712:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.881081:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207117824 00000100:00100000:0.0:1788636774.881112:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207117824 00000100:00100000:0.0:1788636774.881198:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 77 00000100:00100000:0.0:1788636774.881427:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+13:2400:x1875521207117824:12345-192.168.202.26@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788636774.885870:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.887758:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207117952 00000100:00100000:0.0:1788636774.887777:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207117952 00010000:00010000:0.0:1788636774.887877:0:14670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000015d83446/0x5b741ef42e838ff3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ae expref: 14 pid: 9845 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636774.887929:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 101 00000100:00100000:0.0:1788636774.887942:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+14:2401:x1875521207117952:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636774.889254:0:14670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636774.889268:0:14670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000015d83446/0x5b741ef42e838ff3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ae expref: 14 pid: 9845 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.889290:0:14670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000015d83446/0x5b741ef42e838ff3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ae expref: 14 pid: 9845 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.889392:0:14670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636774.889398:0:14670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636774.889407:0:14670:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.889421:0:14670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.889452:0:14670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:3.0:1788636774.889703:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1788636774.889714:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1788636774.890169:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2400:x1875521207117824:12345-192.168.202.26@tcp:16:lhsmtool_posix.0 Request processed in 8948us (9467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.890182:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 77 00000100:00100000:0.0:1788636774.891106:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207117952:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 3162us (5251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636774.891119:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 101 00010000:00010000:1.0:1788636774.892093:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015d83446/0x5b741ef42e838ff3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef392ae expref: 7 pid: 9845 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636774.892124:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002493100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1875521226048000:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636774.892288:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.892444:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.892455:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.892468:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.892477:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.892607:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788636774.892893:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521226047744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19433us (20520us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788636774.892905:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788636774.893200:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788636774.893228:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1788636774.893251:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf03fccce00, transno 4294967322 00000100:00100000:3.0:1788636774.893272:0:3648:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cf03fccd500 x1875521226047744/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788636790 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788636774.893283:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf03fccd500/2, rc 0, transno 4294967323 00000100:00100000:3.0:1788636774.893289:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226047744:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788636774.895596:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.895701:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207118208 00000100:00100000:1.0:1788636774.895715:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207118208 00000100:00100000:1.0:1788636774.895792:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 245 00000100:00100000:1.0:1788636774.895804:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:12480:x1875521207118208:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788636774.895920:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636774.895965:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e83922a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39348 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.895992:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:1.0:1788636774.895999:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636774.896043:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.896060:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.896097:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636774.896278:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6175666 reply state 00000000540e70e5 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.896294:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.896301:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:1.0:1788636774.896314:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788636774.896318:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636774.896445:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:12480:x1875521207118208:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 643us (1154us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788636774.896453:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 245 00010000:00010000:2.0:1788636774.898461:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636774.898482:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.898497:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636774.898684:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.898701:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.898732:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.898768:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f0a14b9/0x5b741ef42e839246 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.898802:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636774.898804:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636774.898889:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636774.902057:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.902259:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207118336 00000100:00100000:0.0:1788636774.902275:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207118336 00000100:00100000:0.0:1788636774.902366:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 78 00000100:00100000:0.0:1788636774.902381:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207118336:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788636774.902734:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788636774.902740:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788636775 -> 1788636774 00002000:00010000:0.0:1788636774.902743:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788636774 00002000:00010000:0.0:1788636774.902746:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788636775 -> 1788636774 00002000:00010000:0.0:1788636774.902768:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788636774.902911:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207118336:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 Request processed in 532us (864us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788636774.902921:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 78 00000100:00100000:1.0:1788636774.905962:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.906130:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207118592 00000100:00100000:0.0:1788636774.906283:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207118592 00000100:00100000:0.0:1788636774.906387:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 246 00000100:00100000:0.0:1788636774.906401:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:12480:x1875521207118592:12345-192.168.202.26@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788636774.906705:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.906733:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3933a expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.906748:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.906852:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3933a expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.906873:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3933a expref: 22 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636774.906893:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226048128:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636774.907043:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636774.910684:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.910885:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226048128:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636774.910924:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636774.911487:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207118720 00000100:00100000:2.0:1788636774.911498:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207118720 00010000:00010000:2.0:1788636774.911625:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3933a expref: 23 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636774.911679:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 102 00000100:00100000:2.0:1788636774.911692:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+23:2400:x1875521207118720:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636774.911714:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636774.911723:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3933a expref: 23 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.911740:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3933a expref: 23 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.911771:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83920e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3933a expref: 23 pid: 6521 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.911793:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:2.0:1788636774.911799:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.911871:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.911881:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.911907:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636774.911979:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:2400:x1875521207118720:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 290us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636774.911988:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 102 00010000:00010000:0.0:1788636774.912934:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.912952:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.913008:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.913017:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.913025:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.913032:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636774.913038:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.913047:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.913062:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:0.0:1788636774.913065:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788636774.913072:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.913080:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839254 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636774.913177:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:12480:x1875521207118592:12345-192.168.202.26@tcp:55:lhsmtool_posix.0 Request processed in 6776us (7227us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788636774.913214:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 246 00000100:00100000:3.0:1788636774.918151:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.919445:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207118848 00000100:00100000:2.0:1788636774.919463:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207118848 00000100:00100000:2.0:1788636774.919572:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 79 00000100:00100000:2.0:1788636774.919586:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2400:x1875521207118848:12345-192.168.202.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788636774.919658:0:9847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.919686:0:9847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.919697:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636774.919702:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636774.919708:0:9847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.919762:0:9847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.919803:0:9847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 8 pid: 8437 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636774.919859:0:9847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03654700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9847:1875521226048256:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636774.919976:0:9847:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf015d1a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636774.926853:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.926954:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207118976 00000100:00100000:3.0:1788636774.926969:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207118976 00010000:00010000:3.0:1788636774.927027:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 9 pid: 8437 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.927090:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 103 00000100:00100000:3.0:1788636774.927103:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2400:x1875521207118976:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636774.927125:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636774.927158:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 9 pid: 8437 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.927177:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 9 pid: 8437 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.927232:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636774.927239:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636774.927247:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.927259:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.927301:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636774.927386:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+9:2400:x1875521207118976:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 284us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636774.927396:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 103 00010000:00010000:0.0:1788636774.929092:0:9847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035e2039c/0x5b741ef42e839238 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39356 expref: 8 pid: 8437 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636774.929122:0:9847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03654700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9847:1875521226048256:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636774.929158:0:9847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.929174:0:9847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.929182:0:9847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.929626:0:9847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.929640:0:9847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.929651:0:9847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.929660:0:9847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636774.929666:0:9847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.929703:0:9847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.929726:0:9847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.929735:0:9847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83925b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636774.930024:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207118848:12345-192.168.202.26@tcp:1:lhsmtool_posix.0 Request processed in 10437us (11884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636774.930037:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 79 00000100:00100000:2.0:1788636774.934626:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636774.935782:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207119232 00000100:00100000:3.0:1788636774.935800:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207119232 00000100:00100000:3.0:1788636774.935935:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 247 00000100:00100000:3.0:1788636774.935949:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:12480:x1875521207119232:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788636774.936085:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.936109:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39302 expref: 21 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.936121:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.936174:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39302 expref: 21 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.936192:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39302 expref: 21 pid: 11089 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.936222:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226048384:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636774.936361:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788636774.947115:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.947283:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207119360 00000100:00100000:0.0:1788636774.947299:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207119360 00010000:00010000:0.0:1788636774.947378:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39302 expref: 22 pid: 11089 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636774.947439:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 104 00000100:00100000:0.0:1788636774.947452:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:2401:x1875521207119360:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636774.947473:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636774.947482:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39302 expref: 22 pid: 11089 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.947511:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39302 expref: 22 pid: 11089 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.947569:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:0.0:1788636774.947576:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8391b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39325 expref: 22 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.947593:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.947602:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.947611:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.947641:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636774.947723:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:2401:x1875521207119360:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 272us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636774.947731:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 104 00010000:00010000:3.0:1788636774.949068:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1a00/0x5b741ef42e839151 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39302 expref: 21 pid: 11089 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.949102:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226048384:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636774.949140:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.949172:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.949179:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.949488:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.949620:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83921c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39341 expref: 21 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.949634:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.949683:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83921c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39341 expref: 21 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.949704:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83921c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39341 expref: 21 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.949723:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226048512:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636774.949899:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788636774.953259:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636774.953438:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207119488 00000100:00100000:0.0:1788636774.953451:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207119488 00010000:00010000:0.0:1788636774.953568:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83921c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39341 expref: 22 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636774.953621:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 105 00000100:00100000:0.0:1788636774.953634:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:2400:x1875521207119488:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636774.953655:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636774.953664:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83921c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39341 expref: 22 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.953701:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83921c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39341 expref: 22 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.953730:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:0.0:1788636774.953737:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.953750:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.953760:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636774.953784:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636774.953887:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:2400:x1875521207119488:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 255us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636774.953895:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 105 00010000:00010000:3.0:1788636774.955928:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e83921c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39341 expref: 21 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.956029:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226048512:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636774.956064:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.956100:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.956106:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636774.956478:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788636774.956712:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788636774.956755:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788636774.957058:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1875521226048640:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788636774.957151:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636774.957686:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636774.957754:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226048640 00000100:00100000:0.0:1788636774.957765:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226048640 00000100:00100000:0.0:1788636774.960683:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788636774.960719:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875521226048640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788636774.960953:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875521226048640:12345-0@lo:1000:mdt00_002.0 Request processed in 247us (3795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636774.960963:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788636774.961104:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1875521226048640:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788636774.961348:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788636774.961448:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1875521226048768:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788636774.961511:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636774.962055:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03a9f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636774.962110:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226048768 00000100:00100000:2.0:1788636774.962119:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226048768 00000100:00100000:1.0:1788636774.962180:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788636774.962192:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1875521226048768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788636774.962579:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1875521226048768:12345-0@lo:1000:mdt00_002.0 Request processed in 389us (1076us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788636774.962590:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788636774.963114:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1875521226048768:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788636774.963271:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963287:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963298:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963379:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636774.963388:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963399:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963423:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:2.0:1788636774.963449:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636774.963457:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963465:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839269 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963571:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963579:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963586:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963591:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636774.963595:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963601:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963611:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:2.0:1788636774.963614:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636774.963624:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8391b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39325 expref: 24 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963639:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8391b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39325 expref: 24 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963650:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8391b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39325 expref: 24 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.963707:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8391b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39325 expref: 24 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636774.963725:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226048896:192.168.202.26@tcp:105: 00000100:00100000:2.0:1788636774.963962:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf015d1a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636774.970123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.970351:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207119616 00000100:00100000:1.0:1788636774.970367:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207119616 00000100:00100000:1.0:1788636774.970449:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:1.0:1788636774.970463:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:12479:x1875521207119616:12345-192.168.202.26@tcp:49:lfs.0 00000100:00100000:1.0:1788636774.970662:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+25:12479:x1875521207119616:12345-192.168.202.26@tcp:49:lfs.0 Request processed in 201us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636774.970695:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:3.0:1788636774.971487:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1875521226048896:192.168.202.26@tcp:105: 00010000:00010000:3.0:1788636774.971597:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971613:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9800/0x5b741ef42e8391ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971663:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839270 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971699:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839270 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971715:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839270 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971729:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839270 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971737:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839270 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971745:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839270 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971752:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.971757:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839270 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971766:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839270 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971780:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:3.0:1788636774.971784:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636774.971789:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839270 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971798:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839270 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971848:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971862:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971869:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971875:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636774.971878:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971886:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971896:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:3.0:1788636774.971899:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636774.971902:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636774.971909:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e839262 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636774.972185:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:12480:x1875521207119232:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 36237us (38383us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788636774.972197:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 247 00000020:00080000:3.0:1788636774.972214:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788636774.972616:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636774.972623:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636774.973446:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788636774.973461:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636774.980223:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636774.980478:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636774.980635:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207120128 00000100:00100000:2.0:1788636774.980650:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207120128 00000100:00100000:2.0:1788636774.980729:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:2.0:1788636774.980743:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+24:12480:x1875521207120128:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788636774.981153:0:6525:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788636774.981198:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788636774.981273:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.981300:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.981638:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.981652:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.981685:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.981693:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636774.981723:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788636774.981895:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:12480:x1875521207120128:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 1150us (1412us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788636774.981905:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 62 00000020:00080000:2.0:1788636774.981912:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788636774.983995:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636774.984021:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.984039:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636774.984045:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.984058:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.984088:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:1.0:1788636774.984093:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788636774.984101:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.984109:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0800/0x5b741ef42e839277 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636774.984135:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636774.984137:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636774.984139:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636774.985015:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207119872 00000100:00100000:3.0:1788636774.985033:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207119872 00000100:00100000:0.0:1788636774.985239:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 248 00000100:00100000:0.0:1788636774.985253:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:12479:x1875521207119872:12345-192.168.202.26@tcp:58:lfs.0 00000040:00080000:0.0:1788636774.985746:0:13298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788636774.986123:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:12479:x1875521207119872:12345-192.168.202.26@tcp:58:lfs.0 Request processed in 870us (5924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636774.986137:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 248 00000100:00100000:1.0:1788636775.051751:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636775.051878:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207120256 00000100:00100000:0.0:1788636775.051891:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207120256 00000100:00100000:0.0:1788636775.051969:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 249 00000100:00100000:0.0:1788636775.051983:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+26:12482:x1875521207120256:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636775.052016:0:11089:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636775.052045:0:11089:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e83927e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3935d expref: -99 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.052140:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839285 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.052161:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839285 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.052178:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839285 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.052196:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83928c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.052215:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83928c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.052231:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83928c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.052443:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.052480:0:11089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3931e expref: 27 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.052490:0:11089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.053595:0:11089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3931e expref: 27 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.053620:0:11089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3931e expref: 27 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636775.053640:0:11089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226049024:192.168.202.26@tcp:104: 00000100:00100000:0.0:1788636775.053793:0:11089:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10840 going to sleep for 11 seconds 00000100:00100000:0.0:1788636775.058451:0:11089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11089:1875521226049024:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636775.058491:0:11089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636775.066190:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636775.066451:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207120512 00000100:00100000:0.0:1788636775.066463:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207120512 00000100:00100000:0.0:1788636775.066530:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:0.0:1788636775.066541:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+28:6171:x1875521207120512:12345-192.168.202.26@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788636775.066789:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:6171:x1875521207120512:12345-192.168.202.26@tcp:35:ldlm_bl.0 Request processed in 249us (611us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788636775.066798:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:1.0:1788636775.073159:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636775.073286:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207120640 00000100:00100000:0.0:1788636775.073325:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207120640 00010000:00010000:0.0:1788636775.073376:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3931e expref: 29 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636775.073425:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 106 00000100:00100000:0.0:1788636775.073435:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:2400:x1875521207120640:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636775.073451:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636775.073459:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3931e expref: 29 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.073473:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3931e expref: 29 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.073500:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37e00/0x5b741ef42e83919e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3931e expref: 29 pid: 13298 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.073519:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:0.0:1788636775.073526:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.073535:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.073544:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636775.073584:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636775.073645:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+28:2400:x1875521207120640:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 211us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636775.073671:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 106 00010000:00010000:1.0:1788636775.074119:0:11089:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074140:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636775.074219:0:11089:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788636775.074224:0:11089:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788636775.074253:0:11089:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074271:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074283:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839285 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074291:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839285 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074299:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839285 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074316:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636775.074321:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839285 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074330:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839285 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074341:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:1.0:1788636775.074345:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636775.074349:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839285 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074366:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e839285 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074380:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83928c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074386:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83928c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074391:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83928c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074396:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636775.074399:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83928c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074406:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83928c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074414:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9cef021c3f00) 00010000:00010000:1.0:1788636775.074417:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636775.074420:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83928c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074426:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6c00/0x5b741ef42e83928c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074471:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e83927e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3935d expref: 28 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074500:0:11089:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3935d expref: 27 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636775.074509:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:1.0:1788636775.074511:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636775.074513:0:11089:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6400, rc 0) 00000100:00100000:1.0:1788636775.074566:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:12482:x1875521207120256:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 22587us (22833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636775.074573:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 249 00010000:00010000:2.0:1788636775.829389:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788636775.917096:0:14768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636775.917106:0:14768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636775.917142:0:14768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788636775.917152:0:14768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788636776.022428:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636776.022442:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636776.022477:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788636776.022495:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636776.022760:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226049152:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788636776.022917:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad000 going to sleep for 11 seconds 00000100:00100000:1.0:1788636776.029644:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636776.029790:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207120768 00000100:00100000:2.0:1788636776.029853:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207120768 00000100:00100000:2.0:1788636776.029954:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 250 00000100:00100000:2.0:1788636776.029967:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+28:12494:x1875521207120768:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788636776.030016:0:6523:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788636776.030177:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+28:12494:x1875521207120768:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 213us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636776.030185:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 250 00000100:00080000:2.0:1788636776.030221:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636776.033491:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875521226049152:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788636776.042739:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636776.043104:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207121024 00000100:00100000:0.0:1788636776.043116:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207121024 00000100:00100000:0.0:1788636776.043171:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 251 00000100:00100000:0.0:1788636776.043182:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+27:12494:x1875521207121024:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636776.043213:0:13298:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636776.043237:0:13298:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e83929a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39364 expref: -99 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636776.043365:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8392a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636776.043383:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8392a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636776.043397:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8392a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636776.043410:0:13298:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788636776.043547:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7600/0x5b741ef42e83929a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39364 expref: 30 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636776.043564:0:13298:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8392a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39364 expref: 29 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636776.043573:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:0.0:1788636776.043576:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636776.043580:0:13298:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7000, rc 0) 00000100:00100000:0.0:1788636776.043756:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:12494:x1875521207121024:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 576us (1032us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788636776.043764:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 251 00000100:00100000:3.0:1788636776.054155:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636776.054237:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636776.054283:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207121408 00000100:00100000:3.0:1788636776.054297:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207121408 00000100:00100000:3.0:1788636776.054388:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 252 00000100:00100000:3.0:1788636776.054399:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:12494:x1875521207121408:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788636776.054478:0:11089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636776.054495:0:11089:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636776.054508:0:11089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636776.054692:0:11089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636776.054701:0:11089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636776.054707:0:11089:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636776.054713:0:11089:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636776.054718:0:11089:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636776.054743:0:11089:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392af lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636776.054757:0:11089:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:3.0:1788636776.054761:0:11089:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636776.054767:0:11089:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392af lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636776.054773:0:11089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392af lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11089 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636776.054949:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:12494:x1875521207121408:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 550us (709us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788636776.054958:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 252 00000040:00080000:3.0:1788636776.055080:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636776.055086:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636776.055572:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788636776.055583:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636776.056311:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207121152 00000100:00100000:1.0:1788636776.056326:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207121152 00000100:00100000:1.0:1788636776.056415:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:1.0:1788636776.056428:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:2398:x1875521207121152:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636776.056445:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636776.056471:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7000/0x5b741ef42e8392a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39364 expref: 30 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636776.056495:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:1.0:1788636776.056501:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636776.056588:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:2398:x1875521207121152:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 162us (2444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636776.056597:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:0.0:1788636776.070598:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636776.071761:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207121664 00000100:00100000:2.0:1788636776.071774:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207121664 00000100:00100000:2.0:1788636776.072049:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:2.0:1788636776.072063:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+29:12494:x1875521207121664:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788636776.072383:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:12494:x1875521207121664:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 322us (2806us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788636776.072409:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:3.0:1788636776.085393:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636776.085420:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226049280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636776.085507:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636776.085574:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226049280 00000100:00100000:3.0:1788636776.085583:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226049280 00000100:00100000:3.0:1788636776.085643:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788636776.085667:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875521226049280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636776.085701:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636776.085747:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875521226049280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636776.085767:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788636776.085856:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226049280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636776.087548:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636776.087591:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226049408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636776.088663:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636776.089773:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226049408 00000100:00100000:1.0:1788636776.089824:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226049408 00000100:00100000:1.0:1788636776.089929:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788636776.089952:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226049408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636776.089984:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636776.090069:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226049408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636776.090077:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788636776.090141:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226049408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636776.093576:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226049536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636776.093739:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788636776.093904:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636776.094489:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226049536 00000100:00100000:0.0:1788636776.094502:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226049536 00000100:00100000:0.0:1788636776.094588:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788636776.094601:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226049536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636776.094661:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788636776.097913:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226049536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3302us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636776.097929:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788636776.102385:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226049536:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788636776.853103:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636777.109071:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226049664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636777.109162:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636777.109268:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226049664 00000100:00100000:0.0:1788636777.109278:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226049664 00000100:00100000:0.0:1788636777.109341:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788636777.109353:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226049664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636777.109391:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788636777.109453:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226049664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636777.109460:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788636777.109651:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226049664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636777.605403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636777.605435:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636777.605466:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636777.605492:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636777.605518:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636777.605541:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636777.605562:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636777.605595:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207121920 00000100:00100000:1.0:1788636777.605605:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207121920 00000100:00100000:1.0:1788636777.605662:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207122432 00000100:00100000:1.0:1788636777.605666:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207122432 00000100:00100000:1.0:1788636777.605692:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207122048 00000100:00100000:1.0:1788636777.605709:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207122048 00000100:00100000:1.0:1788636777.605726:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207122560 00000100:00100000:1.0:1788636777.605729:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207122560 00000100:00100000:3.0:1788636777.605733:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207121792 00000100:00100000:3.0:1788636777.605737:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207121792 00000100:00100000:1.0:1788636777.605744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 380 00000100:00100000:1.0:1788636777.605753:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:2400:x1875521207121920:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636777.605763:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 402 00000100:00100000:3.0:1788636777.605769:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207121792:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636777.605889:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207122176 00000100:00100000:0.0:1788636777.605894:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207122176 00000100:00100000:0.0:1788636777.605926:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207122304 00000100:00100000:0.0:1788636777.605929:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207122304 00000100:00100000:2.0:1788636777.606071:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 381 00000100:00100000:2.0:1788636777.606081:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207122432:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636777.606134:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 151 00000100:00100000:0.0:1788636777.606141:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207122176:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636777.606190:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:2400:x1875521207121920:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 437us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636777.606207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 380 00000100:00100000:1.0:1788636777.606223:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 382 00000100:00100000:1.0:1788636777.606229:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207122048:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636777.614440:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207121792:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 8654us (9028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636777.614456:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 402 00000100:00100000:3.0:1788636777.614733:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 383 00000100:00100000:3.0:1788636777.614750:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207122560:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636777.614800:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207122560:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 57us (9237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636777.614829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 383 00000100:00100000:2.0:1788636777.621477:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207122432:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 15385us (15971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636777.621494:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 381 00000100:00100000:2.0:1788636777.621911:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 152 00000100:00100000:2.0:1788636777.621928:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207122304:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636777.622031:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207122304:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 109us (16487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636777.622039:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 152 00000100:00100000:0.0:1788636777.626498:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207122176:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 20345us (21019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636777.626528:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 151 00000100:00080000:1.0:1788636777.632138:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636777.632149:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636777.632152:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636777.632156:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636777.632296:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207122048:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 26057us (26766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636777.632311:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 382 00000040:00080000:2.0:1788636777.880635:0:14819:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636777.880644:0:14819:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636777.880678:0:14819:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788636777.880686:0:14819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788636777.881899:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636778.157726:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636778.161421:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207122816 00000100:00100000:3.0:1788636778.161440:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207122816 00000100:00100000:3.0:1788636778.161623:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 253 00000100:00100000:3.0:1788636778.161638:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+30:12515:x1875521207122816:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636778.161681:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636778.161705:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3936b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636778.161912:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8392bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788636778.161919:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788636778.161933:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8392bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636778.161949:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8392bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636778.161964:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788636778.162105:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8c00/0x5b741ef42e8392b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3936b expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636778.162125:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8392bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3936b expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636778.162136:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:3.0:1788636778.162140:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788636778.162145:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9c00, rc 0) 00000100:00100000:3.0:1788636778.162244:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:12515:x1875521207122816:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 610us (4529us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788636778.162251:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 253 00000100:00100000:1.0:1788636778.170272:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636778.170338:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207122944 00000100:00100000:0.0:1788636778.170350:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207122944 00000100:00100000:0.0:1788636778.170421:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 254 00000100:00100000:0.0:1788636778.170433:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:12515:x1875521207122944:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:0.0:1788636778.170605:0:13298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8392cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636778.170624:0:13298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8392cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636778.170637:0:13298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8392cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636778.170679:0:13298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8392cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636778.170687:0:13298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8392cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636778.170695:0:13298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8392cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636778.170701:0:13298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636778.170705:0:13298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8392cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636778.170714:0:13298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8392cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636778.170746:0:13298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:0.0:1788636778.170749:0:13298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636778.170754:0:13298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8392cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636778.170760:0:13298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6000/0x5b741ef42e8392cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13298 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636778.170903:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+32:12515:x1875521207122944:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 471us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636778.170911:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 254 00000100:00100000:1.0:1788636778.331266:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636778.331520:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207123072 00000100:00100000:2.0:1788636778.331531:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207123072 00000100:00100000:2.0:1788636778.331595:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 80 00000100:00100000:2.0:1788636778.331607:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2398:x1875521207123072:12345-192.168.202.26@tcp:101:cat.0 00010000:00010000:2.0:1788636778.331631:0:9847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636778.331655:0:9847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e8392d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39372 expref: -99 pid: 9847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636778.331710:0:9847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c6e66, atime: 0x6a9c6e66, ctime: 0x6a9c6e66, blocks: 0x8 00010000:00010000:2.0:1788636778.331733:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1788636778.331739:0:9847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636778.331751:0:9847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e8392d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39372 expref: 8 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636778.331777:0:9847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e8392d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39372 expref: 8 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636778.331794:0:9847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1c00, rc 0) 00000100:00100000:2.0:1788636778.332359:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2398:x1875521207123072:12345-192.168.202.26@tcp:101:cat.0 Request processed in 752us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636778.332366:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 80 00000100:00100000:2.0:1788636778.336726:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636778.336988:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207123200 00000100:00100000:0.0:1788636778.337000:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207123200 00002000:00100000:0.0:1788636778.337054:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9cef037a8a80 x1875521207123200/t0(0) o3->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:264/0 lens 488/0 e 0 to 0 dl 1788636789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636778.337065:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef037a8a80 with x1875521207123200 ext(0->4095) 00002000:00010000:0.0:1788636778.337071:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef037a8a80 00000100:00100000:0.0:1788636778.337108:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 8 00000100:00100000:0.0:1788636778.337118:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207123200:12345-192.168.202.26@tcp:3:cat.0 00000100:00100000:0.0:1788636778.337374:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+8:2401:x1875521207123200:12345-192.168.202.26@tcp:3:cat.0 Request processed in 257us (658us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788636778.337383:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 8 00002000:00100000:0.0:1788636778.337390:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9cef037a8a80 x1875521207123200/t0(0) o3->a3091a46-1ad5-4415-b7a7-5e4bfab40689@192.168.202.26@tcp:264/0 lens 488/4536 e 0 to 0 dl 1788636789 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636778.337399:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef037a8a80 with x1875521207123200 ext(0->4095) 00002000:00010000:0.0:1788636778.337419:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef037a8a80 00000100:00100000:3.0:1788636778.647801:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636778.647840:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226049792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636778.647922:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636778.648032:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226049792 00000100:00100000:3.0:1788636778.648041:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226049792 00000100:00100000:3.0:1788636778.648097:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788636778.648108:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875521226049792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636778.648149:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788636778.648230:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875521226049792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636778.648237:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788636778.648287:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226049792:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788636778.648589:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636778.648636:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636778.648648:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226049920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636778.648681:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636778.648769:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226049920 00000100:00100000:2.0:1788636778.648774:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226049920 00000100:00100000:2.0:1788636778.648836:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788636778.648845:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226049920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636778.648859:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788636778.648898:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226049920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636778.648905:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788636778.648953:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226049920:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788636778.649081:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636778.649444:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226050304:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649481:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649512:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226050816:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649537:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649559:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226051328:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649581:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649599:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788636778.649605:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226050176:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649626:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649642:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521226050688:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649660:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649681:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521226051200:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649702:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649724:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226050048:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649756:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649774:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226050560:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649796:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649837:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226051072:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649860:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649889:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788636778.649894:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226050432:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649917:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649939:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226050944:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.649961:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636778.649988:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226050304 00000100:00100000:0.0:1788636778.649993:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226050304 00000100:00100000:0.0:1788636778.650027:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226050560 00000100:00100000:0.0:1788636778.650031:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226050560 00000100:00100000:0.0:1788636778.650046:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788636778.650054:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226050304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650099:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226050304:12345-0@lo:400:kworker.0 Request processed in 45us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636778.650105:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788636778.650120:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788636778.650126:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226050560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650156:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226050560:12345-0@lo:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636778.650162:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788636778.650209:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226050304:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650236:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226050560:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650254:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226050816 00000100:00100000:0.0:1788636778.650257:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226050816 00000100:00100000:0.0:1788636778.650284:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226051328 00000100:00100000:0.0:1788636778.650287:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226051328 00000100:00100000:0.0:1788636778.650313:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226050176 00000100:00100000:0.0:1788636778.650316:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226050176 00000100:00100000:0.0:1788636778.650339:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226050688 00000100:00100000:0.0:1788636778.650342:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226050688 00000100:00100000:0.0:1788636778.650354:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226051200 00000100:00100000:0.0:1788636778.650357:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226051200 00000100:00100000:0.0:1788636778.650369:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226050432 00000100:00100000:0.0:1788636778.650372:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226050432 00000100:00100000:0.0:1788636778.650386:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788636778.650392:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226050816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650430:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226050816:12345-0@lo:400:kworker.0 Request processed in 38us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636778.650436:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788636778.650448:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788636778.650455:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226051328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650482:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226051328:12345-0@lo:400:kworker.0 Request processed in 28us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636778.650488:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788636778.650500:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788636778.650505:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226050176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650533:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226050176:12345-0@lo:400:kworker.0 Request processed in 28us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636778.650538:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788636778.650549:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788636778.650555:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521226050688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650582:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521226050688:12345-0@lo:400:kworker.0 Request processed in 28us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636778.650588:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788636778.650599:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788636778.650614:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521226051200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650643:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875521226051200:12345-0@lo:400:kworker.0 Request processed in 31us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636778.650649:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788636778.650662:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788636778.650668:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226050432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650699:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226050432:12345-0@lo:400:kworker.0 Request processed in 32us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636778.650705:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00080000:0.0:1788636778.650721:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636778.650725:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636778.650743:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226050176:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650753:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521226050688:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650762:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521226051200:0@lo:400:kworker.0 00010000:00080000:0.0:1788636778.650773:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef037aa300 x1875521226050816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636778.650784:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226050816:0@lo:400:kworker.0 00010000:00080000:0.0:1788636778.650794:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef037a9500 x1875521226051328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636778.650801:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226051328:0@lo:400:kworker.0 00000100:00100000:0.0:1788636778.650861:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226050432:0@lo:400:kworker.0 00000100:00100000:2.0:1788636778.651178:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226051072 00000100:00100000:2.0:1788636778.651183:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226051072 00000100:00100000:2.0:1788636778.651242:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226050944 00000100:00100000:2.0:1788636778.651245:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226050944 00000100:00100000:2.0:1788636778.651270:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788636778.651278:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875521226051072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636778.651335:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875521226051072:12345-0@lo:400:kworker.0 Request processed in 58us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636778.651342:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788636778.651354:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788636778.651360:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226050944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636778.651387:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226050944:12345-0@lo:400:kworker.0 Request processed in 28us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636778.651393:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788636778.651424:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226050944:0@lo:400:kworker.0 00000100:00100000:2.0:1788636778.651435:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226051072:0@lo:400:kworker.0 00000100:00100000:3.0:1788636778.652215:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226050048 00000100:00100000:3.0:1788636778.652221:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226050048 00000100:00100000:3.0:1788636778.652268:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1788636778.652276:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226050048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636778.652347:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226050048:12345-0@lo:400:kworker.0 Request processed in 72us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636778.652353:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1788636778.652506:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226050048:0@lo:400:kworker.0 00000100:00080000:0.0:1788636778.652694:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788636778.901091:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636779.925751:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788636780.190269:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1788636780.190324:0:6500:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf03a9f03c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788636780.190330:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf004eb8800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf03a9f0180 00000020:00080000:1.0:1788636780.190335:0:6500:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf004eb8b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cef03510000 00000001:00080000:3.0:1788636780.190338:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1788636780.190349:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000020:00080000:1.0:1788636780.190379:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1788636780.190552:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636780.190573:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636780.190581:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636780.190588:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636780.190593:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636780.190601:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636780.190621:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9cef021c3700) 00010000:00010000:0.0:1788636780.190625:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636780.190630:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636780.190637:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36e00/0x5b741ef42e83924d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636780.190765:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000020:00080000:2.0:1788636780.191229:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788636780.191623:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788636780.954511:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636781.205337:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226051456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636781.205450:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636781.205625:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226051584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636781.205656:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636781.205694:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226051456 00000100:00100000:1.0:1788636781.205702:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226051456 00000100:00100000:1.0:1788636781.205767:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226051584 00000100:00100000:1.0:1788636781.205771:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226051584 00000100:00100000:1.0:1788636781.205791:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788636781.205800:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226051456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788636781.205863:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636781.205914:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226051456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636781.205922:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788636781.205938:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788636781.205945:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226051584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636781.205954:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788636781.205982:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226051584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636781.205989:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1788636781.206005:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636781.206044:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788636781.206051:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1788636781.206074:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf03fcc4000, transno 4294967311 00000100:00100000:1.0:1788636781.206097:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226051584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636781.206549:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226051456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636781.207415:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636781.207429:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226051712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636781.207544:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636781.207647:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226051712 00000100:00100000:2.0:1788636781.207655:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226051712 00000100:00100000:2.0:1788636781.207781:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788636781.207789:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226051712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636781.207844:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636781.207894:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226051712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636781.207916:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788636781.208233:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226051712:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788636781.973160:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788636782.231456:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636782.231470:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636782.231588:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788636782.231597:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636782.233027:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226051840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636782.233101:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636782.234292:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226051840 00000100:00100000:0.0:1788636782.234309:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226051840 00000100:00100000:0.0:1788636782.234393:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788636782.234409:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226051840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636782.234688:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788636782.234792:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226051840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 385us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636782.234799:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788636782.235100:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226051840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636782.718761:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636782.718856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207123328 00000100:00100000:3.0:1788636782.718874:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207123328 00000100:00100000:1.0:1788636782.718889:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636782.718935:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636782.718962:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636782.718972:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 404 00000100:00100000:3.0:1788636782.718986:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207123328:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636782.718993:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636782.719019:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636782.719049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636782.719083:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207123584 00000100:00100000:3.0:1788636782.719087:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207123328:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 103us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636782.719089:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207123584 00000100:00100000:3.0:1788636782.719099:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 404 00000100:00100000:1.0:1788636782.719150:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207124096 00000100:00100000:1.0:1788636782.719154:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207124096 00000100:00100000:3.0:1788636782.719159:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207123456 00000100:00100000:3.0:1788636782.719165:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207123456 00000100:00100000:1.0:1788636782.719209:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207123968 00000100:00100000:1.0:1788636782.719213:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207123968 00000100:00100000:3.0:1788636782.719225:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 390 00000100:00100000:3.0:1788636782.719235:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207123584:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636782.719242:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 391 00000100:00100000:1.0:1788636782.719252:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207124096:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636782.719285:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207123584:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 42us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636782.719293:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207124096:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 42us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636782.719297:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 390 00000100:00100000:1.0:1788636782.719307:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 391 00000100:00100000:3.0:1788636782.719320:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 392 00000100:00100000:1.0:1788636782.719332:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 393 00000100:00100000:3.0:1788636782.719333:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2401:x1875521207123456:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636782.719346:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207123968:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636782.719369:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2401:x1875521207123456:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 41us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636782.719377:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 392 00000100:00100000:1.0:1788636782.719384:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2401:x1875521207123968:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 41us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636782.719391:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 393 00000100:00080000:3.0:1788636782.719419:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636782.719424:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636782.719496:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207123840 00000100:00100000:2.0:1788636782.719501:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207123840 00000100:00100000:2.0:1788636782.719539:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207123712 00000100:00100000:2.0:1788636782.719543:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207123712 00000100:00100000:2.0:1788636782.719564:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 155 00000100:00100000:2.0:1788636782.719571:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207123840:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636782.719604:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2401:x1875521207123840:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 34us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636782.719610:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 155 00000100:00100000:2.0:1788636782.719622:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 156 00000100:00100000:2.0:1788636782.719628:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207123712:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636782.719649:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2401:x1875521207123712:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 21us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636782.719656:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 156 00000100:00080000:3.0:1788636782.733487:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636782.733499:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1788636782.742287:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788636783.000856:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636783.765134:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636783.765182:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226051968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636783.765311:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636783.765428:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226051968 00000100:00100000:2.0:1788636783.765441:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226051968 00000100:00100000:1.0:1788636783.765863:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226052352:0@lo:400:kworker.0 00000100:00100000:1.0:1788636783.765912:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636783.765937:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226052864:0@lo:400:kworker.0 00000100:00100000:1.0:1788636783.765982:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636783.766002:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226053376:0@lo:400:kworker.0 00000100:00100000:1.0:1788636783.766025:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636783.766115:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226052480:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.766326:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788636783.766341:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226051968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636783.766380:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788636783.766435:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226051968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636783.766443:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1788636783.766471:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636783.766487:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226052224:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.766522:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226052352 00000100:00100000:2.0:1788636783.766596:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226052352 00000100:00100000:2.0:1788636783.766637:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788636783.766643:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226052352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.766733:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226052352:12345-0@lo:400:kworker.0 Request processed in 40us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636783.766741:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788636783.766767:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226052096:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.766802:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636783.766847:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226052608:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.766871:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636783.766888:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226053120:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.766911:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636783.766962:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226051968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636783.767003:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226052096 00000100:00100000:2.0:1788636783.767007:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226052096 00000100:00100000:2.0:1788636783.767043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1788636783.767050:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226052096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.767103:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226052096:12345-0@lo:400:kworker.0 Request processed in 53us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636783.767110:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1788636783.767140:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226052608 00000100:00100000:2.0:1788636783.767143:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226052608 00000100:00100000:2.0:1788636783.767178:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788636783.767185:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226052608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.767221:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226052608:12345-0@lo:400:kworker.0 Request processed in 36us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636783.767226:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788636783.767246:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226053120 00000100:00100000:2.0:1788636783.767250:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226053120 00000100:00100000:2.0:1788636783.767282:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788636783.767288:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226053120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.767316:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226053120:12345-0@lo:400:kworker.0 Request processed in 29us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636783.767322:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1788636783.767337:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636783.767359:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226052096:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.767368:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226052608:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.767375:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226053120:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.773125:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226053632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636783.773252:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636783.773357:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226053632 00000100:00100000:2.0:1788636783.773370:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226053632 00000100:00100000:2.0:1788636783.773473:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788636783.773486:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226053632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636783.773541:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788636783.773606:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226053632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636783.773614:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1788636783.773643:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636783.773850:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788636783.773859:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf03fccd500, transno 4294967323 00000004:00080000:2.0:1788636783.773874:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788636783.773911:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226053632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636783.774773:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226052352:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.775152:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636783.779162:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226052736:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.779393:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636783.779415:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226052864 00000100:00100000:0.0:1788636783.779428:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226052864 00000100:00100000:0.0:1788636783.779523:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226053376 00000100:00100000:0.0:1788636783.779538:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226053376 00000100:00100000:0.0:1788636783.779572:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226052224 00000100:00100000:0.0:1788636783.779576:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226052224 00000100:00100000:0.0:1788636783.779594:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788636783.779604:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226052864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636783.779707:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226052864:12345-0@lo:400:kworker.0 Request processed in 104us (13724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636783.779715:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788636783.779735:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788636783.779741:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226053376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636783.779771:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226053376:12345-0@lo:400:kworker.0 Request processed in 30us (13745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636783.779777:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788636783.779788:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788636783.779794:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226052224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636783.779860:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226052224:12345-0@lo:400:kworker.0 Request processed in 67us (4710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636783.779867:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00080000:0.0:1788636783.779926:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0337e300 x1875521226052864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636783.779973:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226052864:0@lo:400:kworker.0 00010000:00080000:0.0:1788636783.779992:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc4000 x1875521226053376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636783.780001:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226053376:0@lo:400:kworker.0 00000100:00080000:0.0:1788636783.784124:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636783.793193:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226053248:0@lo:400:kworker.0 00000100:00100000:3.0:1788636783.793370:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636783.795494:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226052736 00000100:00100000:1.0:1788636783.795515:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226052736 00000100:00100000:1.0:1788636783.795617:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226052480 00000100:00100000:1.0:1788636783.795621:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226052480 00000100:00100000:1.0:1788636783.795657:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788636783.795671:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226052736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636783.801900:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226052992:0@lo:400:kworker.0 00000100:00080000:0.0:1788636783.802108:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636783.802143:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788636783.802164:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226052480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.802619:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636783.802861:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226052736:12345-0@lo:400:kworker.0 Request processed in 7191us (23467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636783.802873:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788636783.802907:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226053248 00000100:00100000:1.0:1788636783.802916:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226053248 00000100:00100000:3.0:1788636783.803263:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636783.803411:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226053504:0@lo:400:kworker.0 00000100:00100000:3.0:1788636783.803452:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636783.803554:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788636783.803565:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226053248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636783.803618:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226053248:12345-0@lo:400:kworker.0 Request processed in 55us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636783.803625:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1788636783.803954:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226052224:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.803974:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226052736:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.803988:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226053248:0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.804089:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226052992 00000100:00100000:2.0:1788636783.804096:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226052992 00000100:00100000:2.0:1788636783.804142:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226053504 00000100:00100000:2.0:1788636783.804146:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226053504 00000100:00100000:2.0:1788636783.804179:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788636783.804188:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226052992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.804248:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226052992:12345-0@lo:400:kworker.0 Request processed in 62us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636783.804256:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788636783.804283:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788636783.804290:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226053504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636783.804320:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226053504:12345-0@lo:400:kworker.0 Request processed in 31us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636783.804326:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788636783.811873:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226052480:12345-0@lo:400:kworker.0 Request processed in 9693us (18479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636783.811900:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00080000:0.0:1788636783.811972:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636783.811981:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636783.813760:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226052480:0@lo:400:kworker.0 00000100:00100000:3.0:1788636783.813790:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226052992:0@lo:400:kworker.0 00000100:00100000:3.0:1788636783.813805:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226053504:0@lo:400:kworker.0 00010000:00010000:1.0:1788636784.021311:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636784.362730:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636784.362794:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207124224 00000100:00100000:0.0:1788636784.362834:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207124224 00000100:00080000:1.0:1788636784.362918:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636784.362920:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 255 00000100:00100000:0.0:1788636784.366123:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:12159:x1875521207124224:12345-192.168.202.26@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788636784.366404:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:12159:x1875521207124224:12345-192.168.202.26@tcp:60:lhsmtool_posix.0 Request processed in 3459us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636784.366422:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 255 00000100:00100000:2.0:1788636784.372766:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636784.372966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207124352 00000100:00100000:0.0:1788636784.372984:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207124352 00000100:00100000:0.0:1788636784.373071:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 256 00000100:00100000:0.0:1788636784.373087:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:12159:x1875521207124352:12345-192.168.202.26@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788636784.373252:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:12159:x1875521207124352:12345-192.168.202.26@tcp:60:lhsmtool_posix.0 Request processed in 169us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636784.373260:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 256 00000100:00080000:1.0:1788636784.375563:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636784.390769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636784.391527:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207124608 00000100:00100000:2.0:1788636784.391546:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207124608 00000100:00100000:2.0:1788636784.391648:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 65 00000100:00100000:2.0:1788636784.391661:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:12159:x1875521207124608:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788636784.392227:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:12159:x1875521207124608:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 565us (1472us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788636784.392239:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 65 00000100:00100000:0.0:1788636784.546410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636784.547011:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207124736 00000100:00100000:2.0:1788636784.547029:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207124736 00000100:00100000:2.0:1788636784.547160:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 257 00000100:00100000:2.0:1788636784.547187:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:12972:x1875521207124736:12345-192.168.202.26@tcp:101:lsof.0 00010000:00010000:2.0:1788636784.547222:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636784.547445:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8392d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39379 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788636784.547451:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636784.547607:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8392e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636784.547644:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8392e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636784.547662:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8392e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636784.547737:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788636784.547741:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636784.547778:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8392e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636784.547910:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0400/0x5b741ef42e8392d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39379 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636784.547937:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8392e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39379 expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636784.547946:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf015d06300) 00010000:00010000:2.0:1788636784.547949:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636784.547952:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1200, rc 0) 00000100:00100000:2.0:1788636784.548070:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:12972:x1875521207124736:12345-192.168.202.26@tcp:101:lsof.0 Request processed in 885us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636784.548082:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 257 00010000:00010000:2.0:1788636785.045202:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636786.069104:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636786.327470:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226053760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636786.327598:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636786.327993:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636786.328004:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226053888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636786.328046:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636786.328117:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226053888 00000100:00100000:2.0:1788636786.328128:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226053888 00000100:00100000:2.0:1788636786.328229:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788636786.328240:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226053888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636786.328292:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788636786.328352:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226053888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636786.328361:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788636786.328442:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226053888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636786.328850:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226053760 00000100:00100000:3.0:1788636786.328857:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226053760 00000100:00100000:3.0:1788636786.328915:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788636786.328934:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226053760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636786.328973:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636786.329021:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226053760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636786.329028:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1788636786.329261:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636786.330394:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226053760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636786.330498:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636786.330515:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226054016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636786.330591:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636786.330846:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226054016 00000100:00100000:2.0:1788636786.330856:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226054016 00000100:00100000:2.0:1788636786.330943:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788636786.330957:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226054016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636786.330994:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636786.331060:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226054016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636786.331068:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1788636786.331154:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636786.331251:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226054016:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788636786.335719:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1788636786.335750:0:6500:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788636786.337334:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788636786.337360:0:6553:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788636787.096717:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636787.354880:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636787.354933:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226054144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636787.355056:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636787.355268:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226054144 00000100:00100000:0.0:1788636787.355281:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226054144 00000100:00100000:0.0:1788636787.355374:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788636787.355387:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226054144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636787.355441:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788636787.355516:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226054144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636787.355523:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788636787.355653:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226054144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636787.841565:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636787.841638:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636787.841675:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636787.841718:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636787.841751:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636787.841968:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207124864 00000100:00100000:2.0:1788636787.841988:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207124864 00000100:00100000:2.0:1788636787.842088:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 406 00000100:00100000:2.0:1788636787.842102:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207124864:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636787.842260:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3da5b26b-f5ec-400d-b893-346cfc652707+13:2400:x1875521207124864:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 160us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636787.842313:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 406 00000100:00100000:1.0:1788636787.842619:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207125120 00000100:00100000:1.0:1788636787.842627:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207125120 00000100:00100000:1.0:1788636787.842703:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207125632 00000100:00100000:1.0:1788636787.842708:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207125632 00000100:00100000:1.0:1788636787.842742:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207124992 00000100:00100000:1.0:1788636787.842746:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207124992 00000100:00100000:1.0:1788636787.842776:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 400 00000100:00100000:1.0:1788636787.842785:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207125120:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636787.842889:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207125120:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 105us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636787.842896:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 400 00000100:00100000:1.0:1788636787.843452:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 401 00000100:00100000:1.0:1788636787.843466:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207125632:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636787.843506:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2400:x1875521207125632:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 45us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636787.843513:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 401 00000100:00100000:1.0:1788636787.843532:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 402 00000100:00100000:1.0:1788636787.843540:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2400:x1875521207124992:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636787.843573:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2400:x1875521207124992:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 35us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636787.843600:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 402 00000100:00100000:0.0:1788636787.843790:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207125376 00000100:00100000:0.0:1788636787.843800:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207125376 00000100:00100000:0.0:1788636787.843902:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 160 00000100:00100000:0.0:1788636787.843912:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207125376:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636787.843967:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2400:x1875521207125376:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 57us (2290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636787.843975:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 160 00000100:00080000:2.0:1788636787.844505:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636787.844516:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636787.844520:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636787.853587:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636787.853673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636787.854115:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207125248 00000100:00100000:2.0:1788636787.854135:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207125248 00000100:00100000:2.0:1788636787.854293:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 161 00000100:00100000:2.0:1788636787.854319:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207125248:12345-192.168.202.26@tcp:400:kworker.0 00000100:00080000:3.0:1788636787.854337:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636787.854438:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2400:x1875521207125248:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 132us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636787.854448:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 161 00000100:00100000:1.0:1788636787.854658:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207125504 00000100:00100000:1.0:1788636787.854665:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207125504 00000100:00100000:1.0:1788636787.854729:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 403 00000100:00100000:1.0:1788636787.854737:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207125504:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636787.854773:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2400:x1875521207125504:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 38us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636787.854780:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 403 00000100:00080000:2.0:1788636787.854963:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636788.120521:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636788.889070:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226054272:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.889210:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.889307:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226054272 00000100:00100000:0.0:1788636788.889318:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226054272 00000100:00100000:0.0:1788636788.889386:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788636788.889399:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521226054272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.889464:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521226054272:12345-0@lo:400:kworker.0 Request processed in 68us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.889474:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788636788.889539:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226054272:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.889582:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636788.889589:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226054400:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.889618:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.889652:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226054400 00000100:00100000:0.0:1788636788.889656:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226054400 00000100:00100000:0.0:1788636788.889690:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788636788.889698:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226054400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.889736:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226054400:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.889744:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788636788.889778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226054400:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.889853:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636788.889861:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226054528:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.889891:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.889918:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226054528 00000100:00100000:0.0:1788636788.889922:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226054528 00000100:00100000:0.0:1788636788.889949:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788636788.889965:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226054528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890004:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226054528:12345-0@lo:400:kworker.0 Request processed in 41us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.890011:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788636788.890040:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226054528:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890070:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226054656:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890096:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.890127:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226054656 00000100:00100000:0.0:1788636788.890131:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226054656 00000100:00100000:0.0:1788636788.890170:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1788636788.890179:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226054656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890215:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226054656:12345-0@lo:400:kworker.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.890222:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1788636788.890248:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226054656:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890281:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226054784:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890304:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.890344:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636788.890350:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226054912:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890373:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.890399:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226054912 00000100:00100000:0.0:1788636788.890402:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226054912 00000100:00100000:0.0:1788636788.890441:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1788636788.890448:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226054912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890483:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226054912:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.890497:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00080000:0.0:1788636788.890514:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636788.890537:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226054912:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890566:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636788.890573:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226055040:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890598:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.890632:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226055040 00000100:00100000:0.0:1788636788.890636:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226055040 00000100:00100000:0.0:1788636788.890665:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788636788.890671:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226055040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890706:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226055040:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.890712:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00080000:0.0:1788636788.890727:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788636788.890746:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0422a300 x1875521226055040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636788.890757:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226055040:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890782:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226055168:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890841:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.890875:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226055168 00000100:00100000:0.0:1788636788.890879:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226055168 00000100:00100000:0.0:1788636788.890914:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788636788.890921:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226055168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.890955:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226055168:12345-0@lo:400:kworker.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.890971:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1788636788.890992:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636788.891010:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226055168:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.891041:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226055296:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.891063:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.891103:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636788.891108:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226055424:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.891134:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.891152:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226055424 00000100:00100000:0.0:1788636788.891168:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226055424 00000100:00100000:0.0:1788636788.891197:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1788636788.891209:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226055424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.891240:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226055424:12345-0@lo:400:kworker.0 Request processed in 37us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.891248:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00080000:0.0:1788636788.891263:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636788.891278:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226054784 00000100:00100000:0.0:1788636788.891282:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226055424:0@lo:400:kworker.0 00000100:00100000:3.0:1788636788.891288:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226054784 00000100:00100000:0.0:1788636788.891310:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636788.891316:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226055552:0@lo:400:kworker.0 00000100:00100000:3.0:1788636788.891336:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788636788.891338:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636788.891343:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226054784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.891360:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226055552 00000100:00100000:0.0:1788636788.891363:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226055552 00000100:00100000:3.0:1788636788.891385:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226054784:12345-0@lo:400:kworker.0 Request processed in 43us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.891387:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1788636788.891391:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788636788.891393:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226055552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.891424:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226055552:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.891438:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00080000:0.0:1788636788.891454:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788636788.891473:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf012918e00 x1875521226055552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636788.891483:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226055552:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.891511:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226055680:0@lo:400:kworker.0 00000100:00100000:3.0:1788636788.891526:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226054784:0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.891532:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636788.891558:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226055296 00000100:00100000:0.0:1788636788.891563:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226055296 00000100:00100000:0.0:1788636788.891614:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226055680 00000100:00100000:0.0:1788636788.891617:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226055680 00000100:00100000:0.0:1788636788.891636:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788636788.891642:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226055296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.891675:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226055296:12345-0@lo:400:kworker.0 Request processed in 33us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.891680:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788636788.891691:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788636788.891697:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226055680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636788.891725:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226055680:12345-0@lo:400:kworker.0 Request processed in 28us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636788.891730:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788636788.891767:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226055680:0@lo:400:kworker.0 00000100:00100000:1.0:1788636788.891786:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636788.891796:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226055808:0@lo:400:kworker.0 00000100:00100000:1.0:1788636788.891858:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636788.891901:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226055808 00000100:00100000:1.0:1788636788.891905:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226055808 00000100:00100000:1.0:1788636788.891941:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788636788.891949:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226055808:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788636788.891964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636788.891967:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636788.891984:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226055808:12345-0@lo:400:kworker.0 Request processed in 36us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636788.891985:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226055296:0@lo:400:kworker.0 00000100:00100000:1.0:1788636788.892003:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788636788.892029:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226055808:0@lo:400:kworker.0 00000100:00100000:3.0:1788636788.895677:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226055936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636788.895772:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636788.895878:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226055936 00000100:00100000:3.0:1788636788.895890:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226055936 00000100:00100000:3.0:1788636788.895964:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788636788.895975:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226055936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636788.896016:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788636788.896072:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226055936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636788.896079:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788636788.896167:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226055936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636788.900727:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226056064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636788.900861:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636788.900970:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226056064 00000100:00100000:1.0:1788636788.900982:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226056064 00000100:00100000:1.0:1788636788.901047:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788636788.901059:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226056064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636788.901085:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788636788.901150:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226056064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636788.901183:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788636788.901450:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226056064:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788636789.141701:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788636789.444285:0:15018:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:33:07 (1788636787) 00010000:00010000:0.0:1788636790.177567:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636791.197436:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636791.450468:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226056192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636791.450578:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636791.450690:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226056192 00000100:00100000:0.0:1788636791.450700:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226056192 00000100:00100000:0.0:1788636791.450773:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788636791.450787:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226056192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636791.450844:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636791.450896:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226056192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636791.450903:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788636791.450966:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226056192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788636791.452418:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636791.452432:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636791.452449:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226056320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636791.452516:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636791.452569:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226056320 00000100:00100000:3.0:1788636791.452576:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226056320 00000100:00100000:3.0:1788636791.452627:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788636791.452636:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226056320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636791.452659:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636791.452702:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226056320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636791.452710:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:3.0:1788636791.452730:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636791.452761:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226056320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636791.462094:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226056448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636791.462191:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636791.462314:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226056448 00000100:00100000:1.0:1788636791.462323:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226056448 00000100:00100000:1.0:1788636791.462384:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788636791.462395:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226056448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788636791.462435:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788636791.462490:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226056448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636791.462498:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788636791.462616:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226056448:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788636792.214312:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636792.469414:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636792.469446:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226056576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636792.469537:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788636792.471668:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636792.471676:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636792.471785:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788636792.471794:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636792.477684:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226056576 00000100:00100000:3.0:1788636792.477698:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226056576 00000100:00100000:3.0:1788636792.477765:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788636792.477777:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226056576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636792.477853:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788636792.477938:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226056576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (8401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636792.477945:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788636792.478442:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226056576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636792.961840:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636792.961885:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636792.961923:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636792.961934:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207125760 00000100:00100000:3.0:1788636792.961946:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207125760 00000100:00100000:0.0:1788636792.961960:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636792.961988:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636792.962006:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 408 00000100:00100000:0.0:1788636792.962014:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636792.962020:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207125760:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636792.962043:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636792.962065:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207126016 00000100:00100000:0.0:1788636792.962070:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207126016 00000100:00100000:3.0:1788636792.962098:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3da5b26b-f5ec-400d-b893-346cfc652707+13:2398:x1875521207125760:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 82us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636792.962107:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 408 00000100:00100000:0.0:1788636792.962117:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207126528 00000100:00100000:0.0:1788636792.962122:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207126528 00000100:00100000:0.0:1788636792.962140:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207125888 00000100:00100000:0.0:1788636792.962143:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207125888 00000100:00080000:3.0:1788636792.962154:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636792.962161:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636792.962162:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207126400 00000100:00100000:0.0:1788636792.962177:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207126400 00000100:00100000:0.0:1788636792.962204:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 410 00000100:00100000:3.0:1788636792.962212:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207126272 00000100:00100000:0.0:1788636792.962213:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207126016:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636792.962218:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207126272 00000100:00100000:3.0:1788636792.962252:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207126144 00000100:00100000:3.0:1788636792.962256:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207126144 00000100:00100000:0.0:1788636792.962265:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207126016:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 53us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636792.962288:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 410 00000100:00100000:0.0:1788636792.962305:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 411 00000100:00100000:0.0:1788636792.962312:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207126528:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636792.962340:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2398:x1875521207126528:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636792.962347:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 411 00000100:00100000:0.0:1788636792.962358:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 412 00000100:00100000:0.0:1788636792.962364:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2398:x1875521207125888:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636792.962387:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:2398:x1875521207125888:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636792.962393:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 412 00000100:00100000:0.0:1788636792.962406:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 413 00000100:00100000:0.0:1788636792.962412:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2398:x1875521207126400:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636792.962432:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2398:x1875521207126400:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 21us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636792.962438:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 413 00000100:00100000:0.0:1788636792.962614:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 166 00000100:00100000:0.0:1788636792.962622:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2398:x1875521207126272:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636792.962656:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 167 00000100:00100000:0.0:1788636792.962659:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2398:x1875521207126272:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 37us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636792.962668:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 166 00000100:00100000:3.0:1788636792.962673:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207126144:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636792.962707:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2398:x1875521207126144:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 40us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636792.962714:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 167 00000100:00080000:3.0:1788636792.962736:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636792.962739:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636792.962742:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788636792.983750:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788636793.237447:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636793.730954:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636793.731155:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207126784 00000100:00100000:2.0:1788636793.731178:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207126784 00000100:00100000:2.0:1788636793.731270:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 66 00000100:00100000:2.0:1788636793.731292:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+18:13195:x1875521207126784:12345-192.168.202.26@tcp:35:umount.0 00000100:00100000:2.0:1788636793.731661:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:13195:x1875521207126784:12345-192.168.202.26@tcp:35:umount.0 Request processed in 377us (715us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788636793.731672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 66 00000100:00100000:0.0:1788636793.737697:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636793.738306:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207127040 00000100:00100000:2.0:1788636793.738338:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207127040 00000100:00100000:2.0:1788636793.738417:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:2.0:1788636793.738428:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:13195:x1875521207127040:12345-192.168.202.26@tcp:35:umount.0 00000100:00100000:2.0:1788636793.738850:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:13195:x1875521207127040:12345-192.168.202.26@tcp:35:umount.0 Request processed in 422us (1171us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788636793.738860:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:0.0:1788636793.743567:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636793.744318:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207127296 00000100:00100000:2.0:1788636793.744332:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207127296 00000100:00100000:2.0:1788636793.744396:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 68 00000100:00100000:2.0:1788636793.744406:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0113b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+20:13195:x1875521207127296:12345-192.168.202.26@tcp:35:umount.0 00000100:00100000:2.0:1788636793.744689:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0113b4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:13195:x1875521207127296:12345-192.168.202.26@tcp:35:umount.0 Request processed in 283us (1129us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788636793.744697:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 68 00000100:00100000:0.0:1788636793.755325:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636793.755411:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207127552 00000100:00100000:2.0:1788636793.755421:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207127552 00000100:00100000:2.0:1788636793.755482:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:2.0:1788636793.755492:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+21:13195:x1875521207127552:12345-192.168.202.26@tcp:35:umount.0 00000100:00100000:2.0:1788636793.755799:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:13195:x1875521207127552:12345-192.168.202.26@tcp:35:umount.0 Request processed in 307us (483us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788636793.755839:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:0.0:1788636793.760904:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636793.760956:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636793.760994:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207127680 00000100:00100000:1.0:1788636793.761009:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207127680 00000100:00100000:0.0:1788636793.761027:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636793.761098:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207127936 00000100:00100000:1.0:1788636793.761102:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207127936 00000100:00100000:2.0:1788636793.761120:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207127808 00000100:00100000:2.0:1788636793.761127:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207127808 00000100:00100000:1.0:1788636793.761132:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:3.0:1788636793.761152:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:1.0:1788636793.761153:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+15:2401:x1875521207127680:12345-192.168.202.26@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788636793.761183:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3da5b26b-f5ec-400d-b893-346cfc652707+15:2401:x1875521207127936:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636793.761207:0:14670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636793.761241:0:14670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000030400/0x5b741ef42e83850a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fa5 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636793.761346:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636793.761359:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab1800/0x5b741ef42e8382b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ecc expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636793.761374:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636793.761437:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207127680:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 293us (551us total) trans 0 rc 0/0 00010000:00010000:3.0:1788636793.761508:0:14670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636793.762036:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3da5b26b-f5ec-400d-b893-346cfc652707+13:2401:x1875521207127936:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 871us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636793.769058:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636793.769506:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207128320 00000100:00100000:2.0:1788636793.769516:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207128320 00000100:00100000:2.0:1788636793.769566:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 81 00000100:00100000:2.0:1788636793.769576:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+7:2397:x1875521207128320:12345-192.168.202.26@tcp:9:umount.0 00000020:00000080:2.0:1788636793.769623:0:9847:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e83884b 00000020:00010000:2.0:1788636793.769634:0:9847:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cef03752000: total 0 00000100:00080000:2.0:1788636793.769642:0:9847:0:(import.c:65:import_set_state_nolock()) ffff9cef03753000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788636793.769692:0:9847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788636793.769903:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2397:x1875521207128320:12345-192.168.202.26@tcp:9:umount.0 Request processed in 327us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636793.769911:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 81 00000020:00010000:2.0:1788636793.769933:0:8452:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cef03752000: total 0 00010000:00010000:2.0:1788636793.769958:0:8452:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cef03752000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788636793.770019:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e8392d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39372 expref: 4 pid: 9847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636793.770057:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6187eb8/0x5b741ef42e838c03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3918f expref: 3 pid: 9845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636793.770072:0:8452:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cef03752000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788636793.770085:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636793.770088:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636793.770090:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636793.781764:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:1.0:1788636793.781841:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:1.0:1788636793.781863:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+12:2401:x1875521207127808:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636793.781889:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636793.781925:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ece000/0x5b741ef42e8381fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38e8d expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636793.781942:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636793.782013:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+11:2401:x1875521207127808:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 161us (20987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636793.782022:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:3.0:1788636793.783089:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:2.0:1788636793.784781:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636793.784858:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207128448 00000100:00100000:3.0:1788636793.784871:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207128448 00000100:00100000:3.0:1788636793.784920:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 82 00000100:00100000:3.0:1788636793.784930:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef037a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2397:x1875521207128448:12345-192.168.202.26@tcp:9:umount.0 00000020:00000080:3.0:1788636793.784964:0:8437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e8385d5 00000100:00080000:3.0:1788636793.784974:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9cef03755800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788636793.785030:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788636793.785220:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef037a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+2:2397:x1875521207128448:12345-192.168.202.26@tcp:9:umount.0 Request processed in 287us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636793.785229:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 82 00010000:00010000:2.0:1788636793.785341:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636793.803493:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636793.803618:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207129472 00000100:00100000:2.0:1788636793.803631:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207129472 00000100:00100000:2.0:1788636793.803701:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 258 00000100:00100000:2.0:1788636793.803714:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+22:2397:x1875521207129472:12345-192.168.202.26@tcp:39:umount.0 00000020:00000080:2.0:1788636793.803751:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838208 00000020:00010000:2.0:1788636793.803769:0:6521:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cef034ca800: total 0 00000100:00080000:2.0:1788636793.803790:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9cef034c9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788636793.803864:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1788636793.803876:0:6510:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cef034ca800: total 0 00010000:00010000:1.0:1788636793.803953:0:6510:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cef034ca800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788636793.804000:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf015d06300) 00010000:00010000:1.0:1788636793.804004:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636793.804013:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36000/0x5b741ef42e838c6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391ab expref: 21 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636793.804039:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:1.0:1788636793.804042:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788636793.804047:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e8392bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3936b expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636793.804059:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3091a46-1ad5-4415-b7a7-5e4bfab40689+19:2397:x1875521207129472:12345-192.168.202.26@tcp:39:umount.0 Request processed in 346us (573us total) trans 4294967527 rc 0/0 00010000:00010000:1.0:1788636793.804064:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:1.0:1788636793.804068:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00000100:00100000:2.0:1788636793.804073:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 258 00010000:00010000:1.0:1788636793.804077:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0e00/0x5b741ef42e8385ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fcf expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636793.804113:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:1.0:1788636793.804117:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788636793.804122:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e838f75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3928b expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636793.804143:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9cef0331c800) 00010000:00010000:1.0:1788636793.804146:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788636793.804151:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e8388a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef390a8 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636793.805837:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec900) 00010000:00010000:0.0:1788636793.805847:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636793.805859:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0c00/0x5b741ef42e838550 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fba expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636793.805889:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:0.0:1788636793.805892:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636793.805897:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7a00/0x5b741ef42e838bc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3917a expref: 14 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636793.805923:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:0.0:1788636793.805926:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636793.805931:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0600/0x5b741ef42e8391b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39325 expref: 13 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636793.805945:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:0.0:1788636793.805948:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788636793.805951:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36200/0x5b741ef42e838bee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39188 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636793.805988:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9cf015d06900) 00010000:00010000:0.0:1788636793.805991:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636793.805995:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6400/0x5b741ef42e839293 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3935d expref: 11 pid: 11089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636793.806025:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9cef0331c000) 00010000:00010000:0.0:1788636793.806028:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636793.806032:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7400/0x5b741ef42e838ae4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39142 expref: 10 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636793.806049:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cef0331c100) 00010000:00010000:0.0:1788636793.806051:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636793.806055:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf015990200/0x5b741ef42e838534 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38fb3 expref: 9 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636793.806069:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9cef0217ad00) 00010000:00010000:0.0:1788636793.806071:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788636793.806075:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6200/0x5b741ef42e838c88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef391b2 expref: 8 pid: 13298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636793.806088:0:6510:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cef034ca800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788636793.806129:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636793.806131:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636793.806134:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636793.829007:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636793.829232:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207129600 00000100:00100000:0.0:1788636793.829247:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207129600 00000100:00100000:0.0:1788636793.829338:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 259 00000100:00100000:0.0:1788636793.829374:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+5:2397:x1875521207129600:12345-192.168.202.26@tcp:39:umount.0 00000020:00000080:0.0:1788636793.829414:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e83820f 00000100:00080000:0.0:1788636793.829432:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9cef034c8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788636793.829471:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788636793.829719:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3091a46-1ad5-4415-b7a7-5e4bfab40689+3:2397:x1875521207129600:12345-192.168.202.26@tcp:39:umount.0 Request processed in 347us (721us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788636793.829729:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 259 00010000:00010000:1.0:1788636793.830207:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636794.005098:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226056704:0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.005123:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226056832:0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.005391:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226056960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636794.005540:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226057088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636794.015664:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636794.015746:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226057344:0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.015780:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636794.015802:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226057856:0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.015851:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636794.015870:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226058368:0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.015891:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636794.015920:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788636794.015927:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226057472:0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.015951:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636794.015968:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226057984:0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.016011:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636794.016045:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226058496:0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.016067:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636794.016111:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226056832 00000100:00100000:3.0:1788636794.016121:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226056832 00000100:00100000:3.0:1788636794.016190:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226057344 00000100:00100000:3.0:1788636794.016194:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226057344 00000100:00100000:3.0:1788636794.016240:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1788636794.016251:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226056832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.016678:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226056832:12345-0@lo:400:kworker.0 Request processed in 427us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636794.016687:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1788636794.016707:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1788636794.016714:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226057344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.016745:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226057344:12345-0@lo:400:kworker.0 Request processed in 32us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636794.016751:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1788636794.016772:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226057472 00000100:00100000:3.0:1788636794.016776:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226057472 00000100:00100000:3.0:1788636794.016799:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788636794.016825:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226057472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.016859:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226057472:12345-0@lo:400:kworker.0 Request processed in 54us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636794.016865:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788636794.016882:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226057856 00000100:00100000:3.0:1788636794.016886:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226057856 00000100:00100000:3.0:1788636794.016915:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226058368 00000100:00100000:3.0:1788636794.016926:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226058368 00000100:00100000:3.0:1788636794.016942:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226057984 00000100:00100000:3.0:1788636794.016944:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226057984 00000100:00100000:3.0:1788636794.016956:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226058496 00000100:00100000:3.0:1788636794.016958:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226058496 00000100:00100000:3.0:1788636794.016969:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788636794.016974:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226057856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636794.017001:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226057856:12345-0@lo:400:kworker.0 Request processed in 27us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636794.017007:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788636794.017017:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788636794.017022:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226058368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.017335:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636794.017381:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226058368:12345-0@lo:400:kworker.0 Request processed in 357us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636794.017383:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226056960 00000100:00100000:1.0:1788636794.017389:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226056960 00000100:00100000:3.0:1788636794.017394:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788636794.017411:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788636794.017427:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788636794.017433:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226057984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.017439:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226056960:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636794.017468:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226057984:12345-0@lo:400:kworker.0 Request processed in 39us (1455us total) trans 0 rc 0/0 00002000:00000024:1.0:1788636794.017469:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788636794.017480:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788636794.017493:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788636794.017502:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226058496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.017518:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226056960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636794.017525:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788636794.017540:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226058496:12345-0@lo:400:kworker.0 Request processed in 40us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636794.017548:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788636794.017581:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226056960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636794.019698:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636794.019764:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226056704 00000100:00100000:0.0:1788636794.019772:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226056704 00000100:00100000:0.0:1788636794.019843:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788636794.019853:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226056704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636794.019910:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226056704:12345-0@lo:400:kworker.0 Request processed in 59us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636794.019917:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788636794.019983:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226056704:0@lo:400:kworker.0 00000100:00100000:0.0:1788636794.020015:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226057216:0@lo:400:kworker.0 00000100:00100000:0.0:1788636794.020050:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636794.020077:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226057728:0@lo:400:kworker.0 00000100:00100000:0.0:1788636794.020103:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636794.020140:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226057728 00000100:00100000:0.0:1788636794.020144:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226057728 00000100:00100000:1.0:1788636794.020452:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226057216 00000100:00100000:1.0:1788636794.020457:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226057216 00000100:00100000:1.0:1788636794.020502:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788636794.020509:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226057216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.020553:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226057216:12345-0@lo:400:kworker.0 Request processed in 44us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636794.020558:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788636794.020600:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226057472:0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.020616:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226057984:0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.020631:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226058496:0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.020646:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226057344:0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.020675:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002492680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226057856:0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.020689:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226058368:0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.020703:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226056832:0@lo:400:kworker.0 00000100:00100000:0.0:1788636794.024298:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1788636794.024338:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226057728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636794.024504:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226057728:12345-0@lo:400:kworker.0 Request processed in 190us (4398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636794.024514:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00080000:3.0:1788636794.025073:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636794.025080:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636794.025092:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636794.025254:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef037aad80 x1875521226057728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636794.025275:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226057728:0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.025288:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226058240:0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.025339:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636794.025379:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226058240 00000100:00100000:1.0:1788636794.025386:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226058240 00000100:00100000:1.0:1788636794.025445:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788636794.025453:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226058240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.025496:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226058240:12345-0@lo:400:kworker.0 Request processed in 44us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636794.025511:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00010000:00080000:1.0:1788636794.025539:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d4380 x1875521226058240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636794.025549:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226058240:0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.025585:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226057216:0@lo:400:kworker.0 00000100:00100000:2.0:1788636794.029765:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636794.029853:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef037abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226057600:0@lo:400:kworker.0 00000100:00100000:2.0:1788636794.029892:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636794.029935:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226057600 00000100:00100000:1.0:1788636794.029942:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226057088 00000100:00100000:2.0:1788636794.029944:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226057600 00000100:00100000:1.0:1788636794.029951:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226057088 00000100:00100000:1.0:1788636794.030018:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788636794.030019:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788636794.030031:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226057088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636794.030034:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226057600:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788636794.030061:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788636794.030089:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226057600:12345-0@lo:400:kworker.0 Request processed in 59us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636794.030096:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788636794.030113:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226057088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636794.030132:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788636794.030150:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226057600:0@lo:400:kworker.0 00000100:00100000:2.0:1788636794.030161:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226058112:0@lo:400:kworker.0 00000100:00100000:2.0:1788636794.030200:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636794.030232:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226058112 00000100:00100000:1.0:1788636794.030237:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226058112 00000100:00100000:1.0:1788636794.030274:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1788636794.030280:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226058112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636794.030313:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226058112:12345-0@lo:400:kworker.0 Request processed in 32us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636794.030319:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1788636794.030579:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef037ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226057088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636794.030605:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226058112:0@lo:400:kworker.0 00000100:00080000:2.0:1788636794.030640:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636794.030646:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788636794.262471:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636795.285112:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636795.665381:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636795.665443:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636795.665482:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636795.665720:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207129856 00000100:00100000:1.0:1788636795.665732:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207129856 00000100:00100000:1.0:1788636795.665802:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207129728 00000100:00100000:1.0:1788636795.665853:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207129728 00000100:00100000:1.0:1788636795.665872:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207129984 00000100:00100000:1.0:1788636795.665875:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207129984 00000100:00100000:1.0:1788636795.665914:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:1.0:1788636795.665928:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+12:2401:x1875521207129856:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636795.665951:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636795.665977:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c6800/0x5b741ef42e838312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f12 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636795.666000:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636795.666084:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+11:2401:x1875521207129856:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 157us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636795.666092:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:1.0:1788636795.666109:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:1.0:1788636795.666115:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+10:2401:x1875521207129728:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636795.666126:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636795.666135:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e83830b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ee1 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636795.666145:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636795.666161:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+9:2401:x1875521207129728:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 47us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636795.666168:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:1.0:1788636795.666223:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:1.0:1788636795.666230:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+8:2401:x1875521207129984:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636795.666238:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636795.666246:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab37c00/0x5b741ef42e838503 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38f9e expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636795.666268:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636795.666286:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3da5b26b-f5ec-400d-b893-346cfc652707+7:2401:x1875521207129984:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 57us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636795.666292:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:3.0:1788636795.682534:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636795.682751:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207130240 00000100:00100000:1.0:1788636795.682765:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207130240 00000100:00100000:1.0:1788636795.682939:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 260 00000100:00100000:1.0:1788636795.682958:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+6:2397:x1875521207130240:12345-192.168.202.26@tcp:39:umount.0 00000020:00000080:1.0:1788636795.683028:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838320 00000020:00010000:1.0:1788636795.683038:0:6521:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cf03a88c800: total 0 00000100:00080000:1.0:1788636795.683044:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9cf03a88b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788636795.683073:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788636795.683284:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2397:x1875521207130240:12345-192.168.202.26@tcp:39:umount.0 Request processed in 330us (762us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788636795.683293:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 260 00000020:00010000:0.0:1788636795.683671:0:8452:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cf03a88c800: total 0 00010000:00010000:0.0:1788636795.683677:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636795.683746:0:8452:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cf03a88c800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788636795.683787:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf015d06300) 00010000:00010000:0.0:1788636795.683791:0:8452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636795.683800:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1200/0x5b741ef42e8392e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39379 expref: 4 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636795.683867:0:8452:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cf03a88c800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788636795.683881:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636795.683883:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636795.683885:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788636795.683964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636795.697972:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636795.698301:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207130368 00000100:00100000:2.0:1788636795.698317:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207130368 00000100:00100000:2.0:1788636795.698502:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 261 00000100:00100000:2.0:1788636795.698516:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+5:2397:x1875521207130368:12345-192.168.202.26@tcp:39:umount.0 00000020:00000080:2.0:1788636795.698570:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838327 00000100:00080000:2.0:1788636795.698583:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9cf03a88b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788636795.698661:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788636795.698951:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e9819a8-2c70-4ce1-8555-108bb564fc06+3:2397:x1875521207130368:12345-192.168.202.26@tcp:39:umount.0 Request processed in 438us (997us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788636795.698960:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 261 00000100:00080000:3.0:1788636795.699058:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788636795.699507:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636795.745145:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636795.745322:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207130624 00000100:00100000:0.0:1788636795.745337:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207130624 00000100:00100000:0.0:1788636795.745417:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 410 00000100:00100000:0.0:1788636795.745431:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+7:2397:x1875521207130624:12345-192.168.202.26@tcp:251:umount.0 00000020:00000080:0.0:1788636795.745499:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e8381e5 00000020:00010000:0.0:1788636795.745510:0:6514:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cef033a7000: total 0 00000100:00080000:0.0:1788636795.745516:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9cef033a4800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788636795.745617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3da5b26b-f5ec-400d-b893-346cfc652707+3:2397:x1875521207130624:12345-192.168.202.26@tcp:251:umount.0 Request processed in 189us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636795.745625:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 410 00000020:00010000:1.0:1788636795.745693:0:6510:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cef033a7000: total 0 00010000:00010000:1.0:1788636795.745784:0:6510:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cef033a7000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788636795.745881:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e8382be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef38ed3 expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636795.745900:0:6510:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cef033a7000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788636795.745924:0:6510:0:(genops.c:885:class_export_put()) final put ffff9cef033a7000/3da5b26b-f5ec-400d-b893-346cfc652707 00010000:00010000:1.0:1788636795.745950:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636795.745952:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636795.745970:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788636795.746472:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef033a7000/3da5b26b-f5ec-400d-b893-346cfc652707 for MGS 00000020:00000080:0.0:1788636795.746529:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef033a4800 for MGS 00010000:00010000:2.0:1788636796.311192:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636796.565118:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636796.565163:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226058624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636796.565292:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636796.565574:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226058624 00000100:00100000:0.0:1788636796.565587:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226058624 00000100:00100000:0.0:1788636796.565687:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788636796.565703:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226058624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636796.565743:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636796.565833:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226058624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636796.565841:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788636796.565937:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226058624:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788636796.566085:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636796.566379:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636796.566394:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226058752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636796.566444:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636796.566527:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226058752 00000100:00100000:1.0:1788636796.566534:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226058752 00000100:00100000:1.0:1788636796.566578:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788636796.566586:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226058752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788636796.566624:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788636796.566669:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226058752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636796.566675:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788636796.566754:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226058752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636796.567040:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636796.570073:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226058880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636796.572090:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636796.572445:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226058880 00000100:00100000:2.0:1788636796.572458:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226058880 00000100:00100000:2.0:1788636796.572546:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788636796.572558:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226058880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636796.572598:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788636796.572668:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226058880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636796.572677:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1788636796.573024:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636796.573090:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226058880:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788636797.333319:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636797.598775:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226059008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636797.598909:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636797.599454:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226059008 00000100:00100000:2.0:1788636797.599467:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226059008 00000100:00100000:2.0:1788636797.599548:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788636797.599559:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226059008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788636797.599623:0:7884:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788636797.599701:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226059008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636797.599710:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788636797.599909:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226059008:0@lo:41:osp-pre-0-1.0 00000020:01000004:1.0:1788636797.972969:0:15213:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788636797.986069:0:15213:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788636797.986177:0:15213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636797.986214:0:15213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636797.986223:0:15213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636797.986231:0:15213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636797.986271:0:15213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788636797.986280:0:15213:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788636797.986387:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788636797.986395:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788636797.986408:0:15213:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788636797.986477:0:15213:0:(import.c:65:import_set_state_nolock()) ffff9cf02696b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788636797.987973:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636797.987993:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636797.988009:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636797.988015:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636797.988033:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636797.988045:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636797.988053:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788636797.988070:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788636797.988077:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788636797.988158:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636797.988166:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636797.988232:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636797.988241:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015990600/0x5b741ef42e83828d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838294 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636797.988245:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788636797.988262:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636797.988264:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636797.988265:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636797.988282:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226059264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636797.988283:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875521226059136:0@lo:39:umount.0 00000100:00100000:0.0:1788636797.990154:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636797.990402:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226059136 00000100:00100000:1.0:1788636797.990415:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226059136 00000100:00100000:1.0:1788636797.990516:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788636797.990529:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875521226059136:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788636797.990572:0:13298:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837dfc 00000100:00080000:1.0:1788636797.990583:0:13298:0:(import.c:65:import_set_state_nolock()) ffff9cf0067d9000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788636797.990672:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3645:x1875521226059136:12345-0@lo:39:umount.0 Request processed in 146us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636797.990680:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1788636797.990694:0:13298:0:(genops.c:885:class_export_put()) final put ffff9cf0113d1000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788636797.990847:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788636797.990961:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf02696b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788636797.990977:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875521226059136:0@lo:39:umount.0 00000100:00080000:1.0:1788636797.992719:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788636797.992731:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788636797.992741:0:15213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1788636797.997894:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788636797.997990:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0113d1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788636797.998077:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf0067d9000 for lustre-MDT0000 00000100:00100000:0.0:1788636797.998422:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226059264 00000100:00100000:0.0:1788636797.998445:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226059264 00000100:00100000:0.0:1788636797.998632:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788636797.998646:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3649:x1875521226059264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636797.998671:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636797.998702:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015990a00/0x5b741ef42e838294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b741ef42e83828d expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636797.998724:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636797.998832:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:3649:x1875521226059264:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636797.998840:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788636798.001764:0:15213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.001795:0:15213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.001823:0:15213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.001832:0:15213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.001898:0:15213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636798.001907:0:15213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.001913:0:15213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.001919:0:15213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.002277:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636798.002370:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.002379:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7e00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636798.002386:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.002400:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636798.002410:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636798.002419:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788636798.002422:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788636798.003432:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.003625:0:15213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.003655:0:15213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636798.003667:0:15213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.003675:0:15213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.003683:0:15213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.003690:0:15213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.003704:0:15213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788636798.003712:0:15213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.003730:0:15213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.003737:0:15213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.003744:0:15213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636798.003752:0:15213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788636798.003757:0:15213:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788636798.003766:0:15213:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788636798.003841:0:15213:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788636798.003847:0:15213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788636798.003853:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788636798.003860:0:15213:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788636798.003868:0:15213:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cf03fc61800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788636798.003874:0:15213:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cf03a602000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788636798.003879:0:15213:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cf03a88e000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788636798.003884:0:15213:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cf03a765000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788636798.003893:0:15213:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9cf03a88c800 1e9819a8-2c70-4ce1-8555-108bb564fc06 192.168.202.26@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788636798.003898:0:15213:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9cef034ca800 a3091a46-1ad5-4415-b7a7-5e4bfab40689 192.168.202.26@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1788636798.003904:0:15213:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9cf03240cd40) has exports, disconnecting them 00000020:00080000:1.0:1788636798.003908:0:15213:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cf03fc61800), last request at 1788636794 00000020:00000080:1.0:1788636798.003917:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e83810c 00000100:00080000:1.0:1788636798.003945:0:15213:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc67800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788636798.004019:0:15213:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf03fc61800): rc 0 00000020:00000080:1.0:1788636798.004022:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf03fc61800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788636798.004046:0:15213:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cf03a602000), last request at 1788636794 00000020:00000080:1.0:1788636798.004049:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837fe6 00000100:00080000:1.0:1788636798.004056:0:15213:0:(import.c:65:import_set_state_nolock()) ffff9cf03a604000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788636798.004064:0:15213:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf03a602000): rc 0 00000020:00000080:1.0:1788636798.004067:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf03a602000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788636798.004071:0:15213:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cf03a88e000), last request at 1788636530 00000020:00000080:1.0:1788636798.004074:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837ee3 00000100:00080000:1.0:1788636798.004077:0:15213:0:(import.c:65:import_set_state_nolock()) ffff9cf03a88d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788636798.004084:0:15213:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf03a88e000): rc 0 00000020:00000080:1.0:1788636798.004086:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf03a88e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788636798.004091:0:15213:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cf03a765000), last request at 1788636530 00000020:00000080:1.0:1788636798.004095:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837ea4 00000100:00080000:1.0:1788636798.004099:0:15213:0:(import.c:65:import_set_state_nolock()) ffff9cf041841000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788636798.004370:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636798.004411:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.004421:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7e00/0x5b741ef42e83829b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8382a2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.004449:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788636798.005562:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005591:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015ecf600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636798.005595:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005607:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636798.005614:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636798.005621:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788636798.005623:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788636798.005626:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788636798.005675:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005683:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636798.005718:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005726:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015ecf600/0x5b741ef42e83819f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8381a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005742:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636798.005746:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005752:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000031a00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636798.005755:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005769:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636798.005777:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636798.005783:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788636798.005785:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788636798.005788:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788636798.005803:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005826:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636798.005833:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005840:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf000031a00/0x5b741ef42e8384f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8384fc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005851:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636798.005855:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005861:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015991c00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636798.005864:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005871:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636798.005889:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636798.005896:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788636798.005898:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788636798.005900:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788636798.005914:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005920:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636798.005928:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005935:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015991c00/0x5b741ef42e837d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e837d62 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.005946:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636798.005948:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636798.005951:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636798.005986:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226059776:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788636798.006358:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc61800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788636798.006423:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a602000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788636798.006448:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a88e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788636798.006751:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03fc67800 for lustre-MDT0000 00000020:00000080:3.0:1788636798.006757:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03a604000 for lustre-MDT0000 00000020:00000080:3.0:1788636798.006761:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03a88d800 for lustre-MDT0000 00000100:00100000:3.0:1788636798.006782:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226059648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636798.006867:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226059392:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788636798.009376:0:15213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:0.0:1788636798.011590:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636798.011714:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226059520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636798.011822:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636798.011895:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226059776 00000100:00100000:0.0:1788636798.011906:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226059776 00000100:00100000:0.0:1788636798.011973:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226059520 00000100:00100000:0.0:1788636798.011977:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226059520 00000100:00100000:0.0:1788636798.012004:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788636798.012015:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3648:x1875521226059776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636798.012048:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636798.012078:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ece400/0x5b741ef42e837d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b741ef42e837d5b expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636798.012099:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636798.012301:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636798.012358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226059264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636798.012399:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636798.012440:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226059392 00000100:00100000:3.0:1788636798.012445:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226059392 00000100:00100000:3.0:1788636798.014727:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226059648 00000100:00100000:3.0:1788636798.014745:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226059648 00000100:00100000:3.0:1788636798.014773:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788636798.014784:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+25:3646:x1875521226059520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636798.014818:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636798.014843:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015ecf200/0x5b741ef42e8381a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b741ef42e83819f expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636798.014862:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636798.014972:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+24:3646:x1875521226059520:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (3164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636798.014980:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788636798.015001:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788636798.015007:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+23:3649:x1875521226059392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636798.015015:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636798.015024:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab1600/0x5b741ef42e8382a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b741ef42e83829b expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636798.015034:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636798.015063:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+22:3649:x1875521226059392:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (2763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636798.015069:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788636798.015081:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788636798.015087:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3647:x1875521226059648:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636798.017252:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+21:3648:x1875521226059776:12345-0@lo:103:ldlm_bl.0 Request processed in 5223us (5660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636798.017271:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788636798.017348:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636798.017395:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636798.017408:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636798.018273:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636798.018311:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000030a00/0x5b741ef42e8384fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5b741ef42e8384f5 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636798.018335:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636798.018736:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3647:x1875521226059648:12345-0@lo:103:ldlm_bl.0 Request processed in 3646us (6333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636798.018746:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788636798.018980:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226059520:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788636798.018995:0:15213:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf03a765000): rc 0 00000004:00000080:1.0:1788636798.019018:0:15213:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb25401c1bae0 00000100:00100000:3.0:1788636798.019035:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226059648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636798.019076:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226059392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636798.019214:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226059776:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788636798.019305:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788636798.019311:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1788636798.021087:0:15213:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788636798.021127:0:15213:0:(import.c:65:import_set_state_nolock()) ffff9cf03a8b0000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788636798.021526:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226059904:0@lo:39:umount.0 00000100:00100000:0.0:1788636798.021633:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636798.021907:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226059904 00000100:00100000:1.0:1788636798.021918:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226059904 00000100:00100000:1.0:1788636798.021985:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788636798.021996:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875521226059904:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788636798.022166:0:6527:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837f3e 00000100:00080000:1.0:1788636798.022259:0:6527:0:(import.c:65:import_set_state_nolock()) ffff9cf03a88f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788636798.022359:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788636798.022578:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3645:x1875521226059904:12345-0@lo:39:umount.0 Request processed in 581us (942us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788636798.022589:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00010000:00010000:0.0:1788636798.022846:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788636798.022893:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03a8b0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788636798.022904:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226059904:0@lo:39:umount.0 00000100:00080000:1.0:1788636798.024835:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788636798.024843:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788636798.024857:0:15213:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788636798.024923:0:15213:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788636798.024955:0:15213:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc1e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788636798.024972:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788636798.024974:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1788636798.024986:0:15213:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788636798.025990:0:15213:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788636798.026025:0:15213:0:(import.c:65:import_set_state_nolock()) ffff9cef034cc800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000001:00100000:1.0:1788636798.026432:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1e9819a8-2c70-4ce1-8555-108bb564fc06 00000001:00080000:1.0:1788636798.026449:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788636798.026454:0:6500:0:(genops.c:885:class_export_put()) final put ffff9cf03a88c800/1e9819a8-2c70-4ce1-8555-108bb564fc06 00000001:00100000:1.0:1788636798.026476:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000001:00080000:1.0:1788636798.026482:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788636798.026490:0:6500:0:(genops.c:885:class_export_put()) final put ffff9cef034ca800/a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000020:00080000:1.0:1788636798.026572:0:15213:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9cf03240cd40) has no exports 00000100:00100000:0.0:1788636798.026644:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226060032:0@lo:9:umount.0 00000100:00100000:0.0:1788636798.026768:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636798.026853:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226060160:0@lo:9:umount.0 00000100:00100000:0.0:1788636798.026883:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636798.026936:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226060032 00000100:00100000:0.0:1788636798.026949:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226060032 00000100:00100000:0.0:1788636798.027019:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226060160 00000100:00100000:0.0:1788636798.027022:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226060160 00000100:00100000:0.0:1788636798.027051:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788636798.027064:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875521226060032:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788636798.028645:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a88c800/1e9819a8-2c70-4ce1-8555-108bb564fc06 for lustre-MDT0000 00000020:00000080:3.0:1788636798.028756:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef034ca800/a3091a46-1ad5-4415-b7a7-5e4bfab40689 for lustre-MDT0000 00000020:00000080:3.0:1788636798.028800:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03a88b000 for lustre-MDT0000 00000020:00000080:3.0:1788636798.028885:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef034c9800 for lustre-MDT0000 00000100:00100000:3.0:1788636798.028928:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788636798.028952:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875521226060160:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788636798.028990:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e8381d0 00000100:00080000:3.0:1788636798.029005:0:8438:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc1f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788636798.029075:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000020:00000080:0.0:1788636798.029226:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e83809c 00000100:00080000:0.0:1788636798.029237:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9cf03ab4d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788636798.029280:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788636798.030785:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3645:x1875521226060032:12345-0@lo:9:umount.0 Request processed in 3713us (4005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636798.030841:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788636798.030866:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc1e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788636798.031793:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636798.031802:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636798.031915:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3645:x1875521226060160:12345-0@lo:9:umount.0 Request processed in 2969us (5025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636798.031928:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1788636798.031986:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788636798.032044:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788636798.032053:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788636798.032065:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226060032:0@lo:9:umount.0 00000100:00080000:1.0:1788636798.032106:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef034cc800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788636798.032129:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788636798.032157:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788636798.032163:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226060160:0@lo:9:umount.0 00010000:00010000:1.0:1788636798.032925:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788636798.060301:0:15213:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9cf03240cd40) has no exports 00000020:00000080:0.0:1788636798.167158:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837db6 00000020:00000080:0.0:1788636798.167175:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf0113d2800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788636798.167965:0:15213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788636798.168058:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788636798.168071:0:15213:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788636798.168076:0:15213:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9cf0056f8000) has no exports 00000020:00000080:3.0:1788636798.169268:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0113d2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788636798.169744:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837daf 00000020:00000080:1.0:1788636798.169755:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf0268dd800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788636798.172398:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0268dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788636798.172501:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636798.172514:0:15213:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788636798.172521:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf0268df000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788636798.172524:0:15213:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0268df000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788636798.172530:0:15213:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1788636798.357080:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636799.125628:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226060672:0@lo:400:kworker.0 00000100:00100000:0.0:1788636799.125723:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636799.125783:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226060544:0@lo:400:kworker.0 00000100:00100000:0.0:1788636799.125787:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521226061184:0@lo:400:kworker.0 00000100:00100000:0.0:1788636799.125865:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226060672 00000100:00100000:2.0:1788636799.125866:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636799.125875:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226060672 00000100:00100000:2.0:1788636799.125902:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521226061056:0@lo:400:kworker.0 00000100:00100000:0.0:1788636799.125925:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226060544 00000100:00100000:0.0:1788636799.125930:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226060544 00000100:00100000:2.0:1788636799.125932:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636799.126090:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226060416:0@lo:400:kworker.0 00000100:00100000:3.0:1788636799.126146:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636799.126201:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226060416 00000100:00100000:3.0:1788636799.126206:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226060416 00000100:00100000:3.0:1788636799.126249:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788636799.126259:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875521226060416:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788636799.126270:0:6526:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788636799.126332:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875521226060416:12345-0@lo:400:kworker.0 Request processed in 60us (173us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788636799.126340:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788636799.126372:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226060288:0@lo:400:kworker.0 00000100:00100000:2.0:1788636799.126399:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636799.126411:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226061440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636799.126412:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636799.126452:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636799.126671:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226061440 00000100:00100000:2.0:1788636799.126676:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226061440 00000100:00100000:2.0:1788636799.126730:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788636799.126739:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226061440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636799.126773:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788636799.126847:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226061440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636799.126854:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788636799.126878:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226060288 00000100:00100000:2.0:1788636799.126883:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226060288 00000100:00100000:2.0:1788636799.126914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1788636799.126929:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3649:x1875521226060288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636799.126970:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3649:x1875521226060288:12345-0@lo:400:kworker.0 Request processed in 42us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636799.126977:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1788636799.134152:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226061056 00000100:00100000:0.0:1788636799.134177:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226061056 00000100:00100000:0.0:1788636799.134244:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788636799.134256:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875521226060672:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788636799.134268:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788636799.134915:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875521226060672:12345-0@lo:400:kworker.0 Request processed in 657us (9188us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788636799.134925:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788636799.134969:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788636799.134976:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875521226060544:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788636799.134983:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788636799.135024:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875521226060544:12345-0@lo:400:kworker.0 Request processed in 47us (9172us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788636799.135030:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788636799.135041:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788636799.135047:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875521226061056:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788636799.135052:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788636799.135075:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875521226061056:12345-0@lo:400:kworker.0 Request processed in 28us (9145us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788636799.135080:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788636799.135116:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636799.135247:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788636799.135254:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9cf03a607000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788636799.135258:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788636799.138135:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788636799.138264:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788636799.138271:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788636799.138277:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788636799.138285:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636799.138290:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 224 00000100:00080000:1.0:1788636799.138300:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cef02083000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636799.138346:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef023fca80 x1875521226061568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636799.138371:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226060672:0@lo:400:kworker.0 00000100:00100000:1.0:1788636799.138408:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226061568:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788636799.138482:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636799.138517:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226061184 00000100:00100000:1.0:1788636799.138524:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226061184 00000100:00100000:1.0:1788636799.138572:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226061568 00000100:00100000:1.0:1788636799.138575:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226061568 00000100:00100000:1.0:1788636799.138587:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1788636799.138595:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521226061184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636799.138644:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875521226061184:12345-0@lo:400:kworker.0 Request processed in 51us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636799.138660:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1788636799.138676:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788636799.138681:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226061568:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788636799.138695:0:11089:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788636799.141457:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3649:1875521226060288:0@lo:400:kworker.0 00000100:00100000:3.0:1788636799.141479:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226060800:0@lo:400:kworker.0 00000100:00100000:2.0:1788636799.141557:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226061440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636799.141573:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788636799.141578:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788636799.141585:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9cf041845000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788636799.141590:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788636799.141596:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9cf041845000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788636799.141601:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 199 00000100:00100000:3.0:1788636799.141610:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226061312:0@lo:400:kworker.0 00000100:00080000:2.0:1788636799.141612:0:3647:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9cf041845000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636799.141645:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636799.141653:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0337e300 x1875521226061696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788636799.141682:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226060544:0@lo:400:kworker.0 00000100:00080000:2.0:1788636799.141702:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788636799.141705:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788636799.141709:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788636799.141712:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788636799.141715:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 251 00000100:00080000:2.0:1788636799.141720:0:3647:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cef03101800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636799.141733:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0337ed80 x1875521226061824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788636799.141743:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3647:1875521226061056:0@lo:400:kworker.0 00000100:00100000:2.0:1788636799.141841:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226060800 00000100:00100000:2.0:1788636799.141942:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226060800 00000100:00100000:2.0:1788636799.142004:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788636799.142014:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226060800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636799.142049:0:9847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226061312 00000100:00100000:3.0:1788636799.142056:0:9847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226061312 00000100:00100000:2.0:1788636799.142087:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226060800:12345-0@lo:400:kworker.0 Request processed in 72us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636799.142096:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1788636799.142104:0:9847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788636799.142112:0:9847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226061312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636799.142237:0:9847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226061312:12345-0@lo:400:kworker.0 Request processed in 126us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636799.142244:0:9847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00080000:3.0:1788636799.142289:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef040f3b80 x1875521226060800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636799.142302:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226060800:0@lo:400:kworker.0 00000100:00100000:3.0:1788636799.142312:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226061312:0@lo:400:kworker.0 00000100:00080000:0.0:1788636799.147569:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9cf03a607000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636799.147582:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 199 00000100:00080000:0.0:1788636799.147591:0:3646:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9cf03a607000 using connection 192.168.202.126@tcp/0@lo 00000100:00080000:0.0:1788636799.147608:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636799.147662:0:3646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0362f100 x1875521226061952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636799.147681:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226060416:0@lo:400:kworker.0 00000100:00100000:0.0:1788636799.147691:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226060928:0@lo:400:kworker.0 00000100:00100000:0.0:1788636799.147755:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788636799.147923:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0362f480 x1875521226061184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636799.147935:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3648:1875521226061184:0@lo:400:kworker.0 00000100:00100000:0.0:1788636799.147969:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521226061696:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788636799.147996:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636799.148018:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226061824:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788636799.148038:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636799.148054:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226061952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788636799.148075:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636799.148111:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226061952 00000100:00100000:0.0:1788636799.148117:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226061952 00000100:00100000:0.0:1788636799.148156:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788636799.148164:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875521226061952:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788636799.148181:0:7884:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788636799.148524:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226061696 00000100:00100000:3.0:1788636799.148531:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226061696 00000100:00100000:3.0:1788636799.148554:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226061824 00000100:00100000:3.0:1788636799.148557:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226061824 00000100:00100000:3.0:1788636799.148571:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788636799.148576:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521226061696:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788636799.148586:0:6521:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788636799.148633:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521226061696:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 54us (634us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788636799.148640:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788636799.148655:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788636799.148659:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521226061824:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788636799.148665:0:6521:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788636799.148687:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521226061824:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 27us (649us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788636799.148692:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788636799.148721:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf041845000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788636799.148725:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788636799.148729:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521226061696:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788636799.148738:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788636799.148740:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788636799.148743:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226061824:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788636799.150541:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875521226061952:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 2369us (2457us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788636799.150930:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:3.0:1788636799.151128:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03a607000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788636799.151135:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788636799.151140:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226061952:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788636799.151338:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226060928 00000100:00100000:2.0:1788636799.151351:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226060928 00000100:00100000:2.0:1788636799.151446:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788636799.151456:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226060928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636799.151532:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226060928:12345-0@lo:400:kworker.0 Request processed in 78us (3776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636799.151540:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000001:00100000:2.0:1788636799.151872:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788636799.151878:0:9516:0:(genops.c:885:class_export_put()) final put ffff9cf03fc19800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788636799.151891:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000020:00000080:2.0:1788636799.151893:0:9516:0:(genops.c:885:class_export_put()) final put ffff9cef03752000/a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000001:00100000:2.0:1788636799.151934:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788636799.151945:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788636799.151948:0:7453:0:(genops.c:885:class_export_put()) final put ffff9cf03a9cb000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788636799.151954:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1e9819a8-2c70-4ce1-8555-108bb564fc06 00000001:00080000:2.0:1788636799.151958:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788636799.151961:0:7453:0:(genops.c:885:class_export_put()) final put ffff9cf03a88d000/1e9819a8-2c70-4ce1-8555-108bb564fc06 00000001:00100000:2.0:1788636799.151966:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000001:00080000:2.0:1788636799.151971:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788636799.151973:0:7453:0:(genops.c:885:class_export_put()) final put ffff9cef034c8800/a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000100:00080000:0.0:1788636799.154135:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1788636799.154157:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc19800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788636799.154239:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef03752000/a3091a46-1ad5-4415-b7a7-5e4bfab40689 for lustre-OST0001 00000020:00000080:0.0:1788636799.154271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a9cb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788636799.154322:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a88d000/1e9819a8-2c70-4ce1-8555-108bb564fc06 for lustre-MDT0001 00000020:00000080:0.0:1788636799.154346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef034c8800/a3091a46-1ad5-4415-b7a7-5e4bfab40689 for lustre-MDT0001 00000020:00000080:0.0:1788636799.154373:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03fc1f000 for lustre-OST0001 00000020:00000080:0.0:1788636799.154393:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef03753000 for lustre-OST0001 00000020:00000080:0.0:1788636799.154421:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03a88f800 for lustre-MDT0001 00000100:00100000:3.0:1788636799.154431:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226060928:0@lo:400:kworker.0 00000020:00000080:0.0:1788636799.154508:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03a88b800 for lustre-MDT0001 00000020:00000080:0.0:1788636799.154512:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef034c8000 for lustre-MDT0001 00000100:00100000:2.0:1788636799.169596:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226061568:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 30900us (31100us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788636799.169615:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1788636799.170893:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636799.170904:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788636799.170909:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226061568:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:1.0:1788636799.171803:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788636799.171833:0:8431:0:(genops.c:885:class_export_put()) final put ffff9cf03ab4f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788636799.171846:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000020:00000080:1.0:1788636799.171849:0:8431:0:(genops.c:885:class_export_put()) final put ffff9cef03756000/a3091a46-1ad5-4415-b7a7-5e4bfab40689 00000020:00000080:0.0:1788636799.171901:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03ab4f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788636799.171949:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef03756000/a3091a46-1ad5-4415-b7a7-5e4bfab40689 for lustre-OST0000 00000020:00000080:0.0:1788636799.171970:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03ab4d800 for lustre-OST0000 00000020:00000080:0.0:1788636799.171975:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef03755800 for lustre-OST0000 00010000:00010000:3.0:1788636799.381154:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636800.405396:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636801.429232:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636801.687027:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226062080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636801.687135:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636801.687559:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226062080 00000100:00100000:0.0:1788636801.687575:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226062080 00000100:00100000:0.0:1788636801.688246:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788636801.688259:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226062080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788636801.688304:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636801.688372:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226062080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636801.688379:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1788636801.693169:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636801.693267:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226062080:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788636802.200099:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788636802.454954:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636803.480303:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788636804.245714:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788636804.245725:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788636804.245731:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf03a607000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636804.245742:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 467 00000100:00100000:1.0:1788636804.245747:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226062208:0@lo:400:kworker.0 00000100:00080000:3.0:1788636804.245753:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788636804.245768:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9cf03a607000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636804.245835:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef035f4380 x1875521226062336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636804.245861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788636804.245865:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788636804.245867:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf041845000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636804.245875:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1788636804.245889:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1788636804.245890:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788636804.245900:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9cf041845000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636804.245949:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcadf80 x1875521226062464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636804.245963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788636804.245967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788636804.245970:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636804.245975:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1788636804.245979:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788636804.245984:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cef02083000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636804.245993:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226062336:0@lo:38:kworker.0 00000100:00100000:3.0:1788636804.246001:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcad180 x1875521226062592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636804.246058:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788636804.246078:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788636804.246083:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788636804.246086:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636804.246095:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 467 00000100:00100000:1.0:1788636804.246096:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521226062464:0@lo:38:kworker.0 00000100:00080000:3.0:1788636804.246100:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788636804.246110:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cef03101800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636804.246142:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcae300 x1875521226062976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636804.246144:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636804.246191:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226062592:0@lo:38:kworker.0 00000100:00100000:3.0:1788636804.246228:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226062720:0@lo:400:kworker.0 00000100:00100000:1.0:1788636804.246242:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636804.246277:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226062976:0@lo:38:kworker.0 00000100:00100000:3.0:1788636804.246305:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636804.246377:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636804.246378:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226062848:0@lo:400:kworker.0 00000100:00100000:3.0:1788636804.246389:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226063232:0@lo:400:kworker.0 00000100:00100000:1.0:1788636804.246419:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636804.246447:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226062336 00000100:00100000:3.0:1788636804.246459:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226062336 00000100:00100000:1.0:1788636804.246472:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636804.246484:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226063104:0@lo:400:kworker.0 00000100:00100000:3.0:1788636804.246507:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788636804.246529:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875521226062336:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788636804.246541:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:3.0:1788636804.246556:0:6526:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788636804.246584:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226062848 00000100:00100000:1.0:1788636804.246595:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226062848 00000100:00100000:1.0:1788636804.246651:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788636804.246660:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226062848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636804.246714:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226062848:12345-0@lo:400:kworker.0 Request processed in 56us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636804.246722:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788636804.246762:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226062848:0@lo:400:kworker.0 00000100:00100000:1.0:1788636804.246793:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636804.246871:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226062464 00000100:00100000:1.0:1788636804.246875:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226062464 00000100:00100000:1.0:1788636804.246892:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226062592 00000100:00100000:1.0:1788636804.246895:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226062592 00000100:00100000:1.0:1788636804.246901:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226062720 00000100:00100000:1.0:1788636804.246904:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226062720 00000100:00100000:1.0:1788636804.246920:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226063104 00000100:00100000:1.0:1788636804.246922:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226063104 00000100:00100000:1.0:1788636804.246933:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226062976 00000100:00100000:1.0:1788636804.246936:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226062976 00000100:00100000:1.0:1788636804.246948:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1788636804.246955:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226062720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636804.246994:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226062720:12345-0@lo:400:kworker.0 Request processed in 39us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636804.247001:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1788636804.247013:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1788636804.247019:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226063104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636804.247049:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226063104:12345-0@lo:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636804.247066:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1788636804.247080:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788636804.247083:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875521226062464:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788636804.247102:0:13298:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788636804.247141:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875521226062464:12345-0@lo:38:kworker.0 Request processed in 55us (1004us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788636804.247147:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788636804.247159:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788636804.247163:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875521226062592:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788636804.247169:0:13298:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788636804.247188:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875521226062592:12345-0@lo:38:kworker.0 Request processed in 24us (955us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788636804.247194:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788636804.247216:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788636804.247219:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875521226062976:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788636804.247225:0:13298:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788636804.247248:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875521226062976:12345-0@lo:38:kworker.0 Request processed in 27us (455us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788636804.247253:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:1.0:1788636804.247290:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcadc00 x1875521226063104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636804.247303:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226063104:0@lo:400:kworker.0 00000100:00080000:1.0:1788636804.247328:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636804.247334:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788636804.247336:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226062592:0@lo:38:kworker.0 00000100:00080000:1.0:1788636804.247355:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636804.247359:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788636804.247361:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226062976:0@lo:38:kworker.0 00000100:00080000:1.0:1788636804.247370:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf041845000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636804.247373:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788636804.247376:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521226062464:0@lo:38:kworker.0 00000100:00100000:1.0:1788636804.247418:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788636804.247447:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcac380 x1875521226062720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636804.247457:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226062720:0@lo:400:kworker.0 00000100:00080000:1.0:1788636804.247491:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636804.247496:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636804.248219:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226063232 00000100:00100000:0.0:1788636804.248228:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226063232 00000100:00100000:0.0:1788636804.248273:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788636804.248280:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226063232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636804.248338:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226063232:12345-0@lo:400:kworker.0 Request processed in 59us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636804.248344:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788636804.249662:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226062208 00000100:00100000:2.0:1788636804.249679:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226062208 00000100:00100000:2.0:1788636804.249731:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1788636804.249742:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3648:x1875521226062208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636804.249847:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3648:x1875521226062208:12345-0@lo:400:kworker.0 Request processed in 107us (3974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636804.249853:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1788636804.251695:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226062208:0@lo:400:kworker.0 00000100:00100000:2.0:1788636804.251730:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636804.251741:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226063360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636804.251820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636804.251863:0:12473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226063360 00000100:00100000:2.0:1788636804.251868:0:12473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226063360 00000100:00100000:2.0:1788636804.251913:0:12473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788636804.251922:0:12473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226063360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636804.251949:0:12473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788636804.251986:0:12473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226063360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636804.251993:0:12473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:1.0:1788636804.254219:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636804.255187:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226063232:0@lo:400:kworker.0 00000100:00100000:2.0:1788636804.260486:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226063360:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788636804.263399:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788636804.263410:0:6500:0:(genops.c:885:class_export_put()) final put ffff9cf03a765000/lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788636804.269662:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875521226062336:12345-0@lo:38:kworker.0 Request processed in 23125us (23597us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788636804.269678:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:2.0:1788636804.269765:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03a607000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636804.269772:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788636804.269776:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226062336:0@lo:38:kworker.0 00000020:00000080:0.0:1788636804.272161:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a765000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788636804.272376:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf041841000 for lustre-MDT0000 00010000:00010000:0.0:1788636804.501253:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636805.525739:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636806.548976:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636806.808286:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226063488:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636806.808561:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636806.808664:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226063488 00000100:00100000:2.0:1788636806.808675:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226063488 00000100:00100000:2.0:1788636806.808739:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788636806.808749:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226063488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636806.808781:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788636806.809631:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636806.810150:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226063488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1396us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636806.810162:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788636806.810911:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226063488:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788636807.575187:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636808.597492:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636809.365317:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226063616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636809.365425:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788636809.366188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788636809.366201:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788636809.366205:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf03a607000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636809.366221:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:3.0:1788636809.366229:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788636809.366240:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9cf03a607000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636809.366270:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcac000 x1875521226063872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636809.366296:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788636809.366300:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788636809.366301:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf041845000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636809.366305:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:3.0:1788636809.366308:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788636809.366312:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9cf041845000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636809.366334:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcaf800 x1875521226064000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636809.366346:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788636809.366375:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788636809.366378:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636809.366382:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 473 00000100:00080000:3.0:1788636809.366385:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788636809.366389:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cef02083000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636809.366401:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcaed80 x1875521226064128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636809.366436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788636809.366440:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788636809.366442:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636809.366445:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 473 00000100:00080000:3.0:1788636809.366448:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788636809.366452:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cef03101800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636809.366463:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcaea00 x1875521226064512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636809.366549:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226063872:0@lo:38:kworker.0 00000100:00100000:1.0:1788636809.366566:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226063744:0@lo:400:kworker.0 00000100:00100000:2.0:1788636809.366702:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226063616 00000100:00100000:2.0:1788636809.366713:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226063616 00000100:00100000:2.0:1788636809.366793:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788636809.366824:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226063616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636809.366863:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1788636809.366937:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636809.366985:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226064384:0@lo:400:kworker.0 00000100:00100000:1.0:1788636809.367030:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636809.367524:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636809.367575:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521226064000:0@lo:38:kworker.0 00000100:00100000:0.0:1788636809.367616:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636809.367646:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226064128:0@lo:38:kworker.0 00000100:00100000:0.0:1788636809.367670:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636809.367694:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226064512:0@lo:38:kworker.0 00000100:00100000:0.0:1788636809.367716:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636809.367775:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226063744 00000100:00100000:0.0:1788636809.367784:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226063744 00000100:00100000:0.0:1788636809.368263:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1788636809.368276:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3648:x1875521226063744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636809.368438:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0323b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c4a4b8e-4887-46f1-83c2-b9af7c6766da+19:3648:x1875521226063744:12345-0@lo:400:kworker.0 Request processed in 165us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636809.368447:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1788636809.368489:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226064640:0@lo:400:kworker.0 00000100:00100000:0.0:1788636809.368517:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636809.368574:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226064000 00000100:00100000:0.0:1788636809.368580:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226064000 00000100:00100000:0.0:1788636809.368601:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226064128 00000100:00100000:0.0:1788636809.368604:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226064128 00000100:00100000:0.0:1788636809.368629:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226064512 00000100:00100000:0.0:1788636809.368632:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226064512 00000100:00100000:0.0:1788636809.368638:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226064640 00000100:00100000:0.0:1788636809.368640:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226064640 00000100:00100000:0.0:1788636809.368670:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1788636809.368677:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226064640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636809.368715:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226064640:12345-0@lo:400:kworker.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636809.368722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:0.0:1788636809.368734:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788636809.368739:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521226064000:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788636809.368753:0:6521:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788636809.374487:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226063616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7667us (9045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636809.374508:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788636809.374589:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788636809.374599:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226064128:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788636809.374626:0:11089:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788636809.374695:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226064128:12345-0@lo:38:kworker.0 Request processed in 96us (7024us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788636809.374703:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788636809.374727:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788636809.374735:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226064512:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788636809.374743:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521226064000:12345-0@lo:38:kworker.0 Request processed in 5988us (7112us total) trans 0 rc -19/-19 00010000:02000000:2.0:1788636809.374749:0:11089:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788636809.374767:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788636809.374797:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226064512:12345-0@lo:38:kworker.0 Request processed in 60us (7078us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788636809.374849:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788636809.374873:0:7884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226063872 00000100:00100000:0.0:1788636809.374884:0:7884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226063872 00000100:00100000:0.0:1788636809.374931:0:7884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788636809.374938:0:7884:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875521226063872:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788636809.374955:0:7884:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788636809.374994:0:7884:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875521226063872:12345-0@lo:38:kworker.0 Request processed in 56us (7474us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788636809.375001:0:7884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00010000:00080000:0.0:1788636809.375050:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcad880 x1875521226064640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636809.375065:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226064640:0@lo:400:kworker.0 00000100:00100000:0.0:1788636809.375089:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226063616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636809.377195:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226064256:0@lo:400:kworker.0 00000100:00100000:0.0:1788636809.377285:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788636809.377937:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636809.377956:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226064256 00000100:00100000:0.0:1788636809.377966:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226064256 00000100:00100000:0.0:1788636809.378040:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1788636809.378050:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226064256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636809.378122:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226064256:12345-0@lo:400:kworker.0 Request processed in 73us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636809.378129:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00080000:0.0:1788636809.378150:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788636809.378183:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcae680 x1875521226064256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636809.378199:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226064256:0@lo:400:kworker.0 00000100:00080000:2.0:1788636809.380587:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf041845000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636809.380607:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788636809.380614:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521226064000:0@lo:38:kworker.0 00000100:00080000:2.0:1788636809.380657:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636809.380663:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788636809.380666:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226064128:0@lo:38:kworker.0 00000100:00080000:2.0:1788636809.380680:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636809.380685:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788636809.380688:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226064512:0@lo:38:kworker.0 00000100:00080000:2.0:1788636809.380731:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03a607000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636809.380735:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788636809.380738:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226063872:0@lo:38:kworker.0 00000100:00100000:3.0:1788636809.381614:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636809.383572:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226064384 00000100:00100000:2.0:1788636809.383594:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226064384 00000100:00100000:2.0:1788636809.383713:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788636809.383730:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226064384:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788636809.383734:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636809.384131:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226064384:12345-0@lo:400:kworker.0 Request processed in 404us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636809.384141:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788636809.384209:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226064384:0@lo:400:kworker.0 00000100:00100000:1.0:1788636809.390287:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226063744:0@lo:400:kworker.0 00010000:00010000:1.0:1788636809.621041:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636810.645693:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636811.669652:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636811.925516:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226064768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636811.925624:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636811.925803:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226064768 00000100:00100000:0.0:1788636811.925849:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226064768 00000100:00080000:1.0:1788636811.926121:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636811.926916:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788636811.926936:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226064768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788636811.926969:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788636811.927041:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226064768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636811.927048:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788636811.927159:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226064768:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1788636812.439337:0:13809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:02000400:1.0:1788636812.439555:0:15213:0:(genops.c:1852:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:1.0:1788636812.449703:0:15213:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cef0315d420 - data ffff9cef01cc7d80/ffff9cef0350e400 00000020:01000000:1.0:1788636812.449904:0:15213:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf0096fe3c0 - data ffff9cf031d67bd0/ffff9cf026b46800 00000001:00000004:2.0:1788636812.467267:0:15213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1788636812.580703:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788636812.580717:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788636812.580741:0:15213:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9cef023fc000 x1875521226059904/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788636808 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636812.580791:0:15213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788636812.583347:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788636812.583357:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788636812.583379:0:15213:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788636812.583382:0:15213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788636812.584175:0:8487:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788636812.584186:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788636812.584203:0:8487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788636812.587513:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788636812.587526:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788636812.587557:0:15213:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788636812.587591:0:15213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788636812.594386:0:9843:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788636812.594407:0:9843:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788636812.594420:0:9843:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788636812.595762:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837d7e 00000020:00000080:3.0:1788636812.595774:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf0067dd800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788636812.595897:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0067dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788636812.605077:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837d93 00000020:00000080:1.0:1788636812.605096:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf032421800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788636812.605113:0:15213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788636812.605118:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788636812.605128:0:15213:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788636812.605134:0:15213:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9cf03240b380) has no exports 00000004:01000000:1.0:1788636812.605366:0:15213:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788636812.605377:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e8381c9 00000020:00000080:1.0:1788636812.605382:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf03fc18800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788636812.605387:0:15213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788636812.605391:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788636812.605402:0:15213:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788636812.605405:0:15213:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9cef034b3380) has no exports 00000020:00000080:1.0:1788636812.605413:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e8381c2 00000020:00000080:1.0:1788636812.605430:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cef034cb800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788636812.605789:0:15213:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788636812.605794:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788636812.605798:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788636812.605828:0:15213:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788636812.605832:0:15213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788636812.605862:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788636812.605871:0:15213:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788636812.605877:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838087 00000020:00000080:1.0:1788636812.605882:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf03ab49800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788636812.605885:0:15213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788636812.605889:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788636812.605893:0:15213:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788636812.605896:0:15213:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9cef019d0000) has no exports 00000020:00000080:1.0:1788636812.605900:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838080 00000020:00000080:1.0:1788636812.605902:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf03fc1d800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788636812.606275:0:15213:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788636812.606278:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788636812.606281:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788636812.606284:0:15213:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788636812.606286:0:15213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788636812.606339:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788636812.606344:0:15213:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788636812.606358:0:15213:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788636812.606363:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837f37 00000020:00000080:1.0:1788636812.606413:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf03a9cf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788636812.606417:0:15213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788636812.606420:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788636812.606424:0:15213:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788636812.606427:0:15213:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9cf040bc4d40) has no exports 00000020:00000080:1.0:1788636812.606430:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837f30 00000020:00000080:1.0:1788636812.606433:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf03a8b4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788636812.612059:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf032421800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788636812.612086:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc18800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788636812.612093:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef034cb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788636812.612100:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef034cc800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788636812.612114:0:8:0:(genops.c:885:class_export_put()) final put ffff9cef03103800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788636812.612116:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef03103800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788636812.612121:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636812.612219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03ab49800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788636812.612252:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc1d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788636812.612270:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03fc1e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788636812.612275:0:8:0:(genops.c:885:class_export_put()) final put ffff9cf03fc1a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788636812.612277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc1a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788636812.612280:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636812.612320:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a9cf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788636812.612325:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a8b4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788636812.704453:0:15213:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788636812.704464:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788636812.704470:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788636812.704483:0:15213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788636812.704568:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636812.704582:0:15213:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636812.704627:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636812.704631:0:15213:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636812.704637:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf0067df000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788636812.704642:0:15213:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0067df000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788636812.704668:0:15213:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636812.704790:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837d9a 00000020:00000080:3.0:1788636812.704798:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf032427800/lustre-MDD0000_UUID 00000020:01000000:3.0:1788636812.704804:0:15213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788636812.704835:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636812.704840:0:15213:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788636812.704844:0:15213:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9cf0324099c0) has no exports 00000020:00000080:3.0:1788636812.704862:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636812.704865:0:15213:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788636812.704869:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837da1 00000020:00000080:3.0:1788636812.704872:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf032425800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788636812.704882:0:15213:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf00324c000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788636812.704885:0:15213:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00324c000 3 00000020:01000004:3.0:1788636812.704888:0:15213:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf00324c000 from lustre-MDT0000 00000020:00000080:3.0:1788636812.704907:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636812.704911:0:15213:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788636812.704913:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf0067de000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788636812.704915:0:15213:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0067de000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788636812.704923:0:15213:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788636812.704952:0:15213:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788636812.704957:0:15213:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788636812.704961:0:15213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788636812.704964:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636812.704967:0:15213:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788636812.704974:0:15213:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9cf0321a5800 2c4a4b8e-4887-46f1-83c2-b9af7c6766da 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788636812.704981:0:15213:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9cf040bc3380) has exports, disconnecting them 00000020:00080000:3.0:1788636812.704986:0:15213:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9cf0321a5800), last request at 1788636510 00000020:00000080:3.0:1788636812.705003:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837d3f 00000020:00010000:3.0:1788636812.705007:0:15213:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cf0321a5800: total 2 00000100:00080000:3.0:1788636812.705012:0:15213:0:(import.c:65:import_set_state_nolock()) ffff9cf0321a7800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788636812.705033:0:15213:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf0321a5800): rc 0 00000020:00080000:3.0:1788636812.705046:0:15213:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9cf040bc3380) has no exports 00000100:00100000:3.0:1788636812.705108:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9cf01dad6c00:6514] 1 exiting: rc = 0 00000100:00100000:2.0:1788636812.705308:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9cf0339ca600:6513] 0 exiting: rc = 1 00000100:00100000:2.0:1788636812.705371:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9cf01dad7c00:6516] 2 exiting: rc = 0 00000020:00000080:2.0:1788636812.705427:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03a8b0000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788636812.705434:0:8:0:(genops.c:885:class_export_put()) final put ffff9cf0268de000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788636812.705436:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0268de000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788636812.705441:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788636812.705499:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf032427800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788636812.705503:0:8:0:(genops.c:885:class_export_put()) final put ffff9cf032423800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788636812.705505:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf032423800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788636812.705508:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788636812.705532:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf032425800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788636812.705595:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705604:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705611:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705617:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705623:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705629:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705634:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705641:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705647:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705653:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705659:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705665:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705674:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705681:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705686:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705692:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705699:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705705:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705711:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705716:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705723:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705728:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705735:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705740:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705746:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705752:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705757:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705763:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705768:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705773:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705780:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705786:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705791:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705833:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705841:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705847:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705852:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705857:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705863:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705869:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705875:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705880:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705886:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705892:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705898:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705903:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705908:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705913:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705918:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705923:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705929:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705934:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705939:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705945:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705951:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705956:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705962:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705968:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705973:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705978:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705983:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705989:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.705995:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636812.706000:0:15213:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788636812.706795:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf000031e00/0x5b741ef42e837e3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e837e34 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706843:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031e00/0x5b741ef42e837e3b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e837e34 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706867:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf0113c6600/0x5b741ef42e838240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e838239 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706877:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c6600/0x5b741ef42e838240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e838239 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706886:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e83824e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e838247 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706893:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e83824e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e838247 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706901:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf03aab0200/0x5b741ef42e83825c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e838255 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706909:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab0200/0x5b741ef42e83825c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e838255 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706916:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf0113c7c00/0x5b741ef42e83826a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e838263 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706923:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7c00/0x5b741ef42e83826a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e838263 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706931:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838278 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e838271 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706939:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015990c00/0x5b741ef42e838278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e838271 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706958:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf000031400/0x5b741ef42e838286 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e83827f expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706966:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031400/0x5b741ef42e838286 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e83827f expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706975:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf015991a00/0x5b741ef42e8382b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e8382a9 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706982:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015991a00/0x5b741ef42e8382b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e8382a9 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.706995:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf015991000/0x5b741ef42e838160 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e838159 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.707002:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf015991000/0x5b741ef42e838160 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e838159 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.707012:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf000031c00/0x5b741ef42e837e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e837e42 expref: 5 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.707020:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031c00/0x5b741ef42e837e49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e837e42 expref: 5 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.707031:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf000031000/0x5b741ef42e8384d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e8384cb expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.707038:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf000031000/0x5b741ef42e8384d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e8384cb expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.707056:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e8384e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e8384d9 expref: 3 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.707065:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153fc00/0x5b741ef42e8384e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e8384d9 expref: 3 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.707074:0:15213:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff9cf00153e400/0x5b741ef42e8384ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x5b741ef42e8384e7 expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636812.707081:0:15213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf00153e400/0x5b741ef42e8384ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x5b741ef42e8384e7 expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1788636812.709799:0:6509:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cf0321a5800: total 0 00010000:00010000:1.0:1788636812.709906:0:6509:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cf0321a5800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788636812.709924:0:6509:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cf0321a5800, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1788636812.709934:0:6509:0:(genops.c:885:class_export_put()) final put ffff9cf0321a5800/2c4a4b8e-4887-46f1-83c2-b9af7c6766da 00010000:00010000:1.0:1788636812.709951:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636812.709954:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636812.709956:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636812.710034:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788636812.710108:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0321a5800/2c4a4b8e-4887-46f1-83c2-b9af7c6766da for MGS 00000020:00000080:3.0:1788636812.710159:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf0321a7800 for MGS 00010000:00010000:3.0:1788636813.717029:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636814.485189:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636814.485217:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226064896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636814.485322:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636814.485494:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226064896 00000100:00100000:2.0:1788636814.485504:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226064896 00000100:00100000:2.0:1788636814.485575:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788636814.485595:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226064896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636814.485630:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788636814.485682:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226064896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636814.485689:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1788636814.485969:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636814.486016:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0337c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226064896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636814.491663:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226065024:0@lo:400:kworker.0 00000400:00000100:0.0:1788636814.491723:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875521226065024 offset 0 length 224: 4 00000100:00080000:1.0:1788636814.491916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788636814.491922:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788636814.491927:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf03a607000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636814.491934:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1788636814.491939:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788636814.491947:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9cf03a607000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636814.491973:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef040f2680 x1875521226065152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636814.491989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788636814.491992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788636814.491994:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf041845000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636814.491999:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1788636814.492001:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788636814.492020:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9cf041845000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636814.492036:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef023fc000 x1875521226065280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636814.492045:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788636814.492048:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788636814.492050:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636814.492053:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1788636814.492056:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788636814.492059:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cef02083000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636814.492070:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf01291a680 x1875521226065408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788636814.492141:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226065536:0@lo:400:kworker.0 00000100:00100000:2.0:1788636814.492181:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636814.492226:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226065152:0@lo:38:kworker.0 00000100:00100000:2.0:1788636814.492265:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636814.492288:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521226065280:0@lo:38:kworker.0 00000100:00100000:2.0:1788636814.492308:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636814.492333:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226065408:0@lo:38:kworker.0 00000100:00100000:2.0:1788636814.492371:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636814.492409:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226065536 00000100:00100000:2.0:1788636814.492418:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226065536 00000100:00100000:2.0:1788636814.492481:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226065280 00000100:00100000:2.0:1788636814.492485:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226065280 00000100:00100000:2.0:1788636814.492500:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226065408 00000100:00100000:2.0:1788636814.492502:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226065408 00000100:00100000:2.0:1788636814.492515:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1788636814.492525:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226065536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636814.492572:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226065536:12345-0@lo:400:kworker.0 Request processed in 49us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636814.493144:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1788636814.493165:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788636814.493170:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226065280:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788636814.493199:0:11089:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788636814.493251:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226065280:12345-0@lo:38:kworker.0 Request processed in 80us (942us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788636814.493257:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788636814.493269:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788636814.493273:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226065408:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788636814.497153:0:11089:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788636814.497262:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226065408:12345-0@lo:38:kworker.0 Request processed in 3985us (4888us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788636814.497274:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:2.0:1788636814.497334:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788636814.497386:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf012918e00 x1875521226065536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636814.497417:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226065536:0@lo:400:kworker.0 00000100:00080000:2.0:1788636814.497475:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf041845000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636814.497481:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788636814.497485:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521226065280:0@lo:38:kworker.0 00000100:00080000:2.0:1788636814.497497:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636814.497501:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788636814.497504:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226065408:0@lo:38:kworker.0 00000100:00100000:3.0:1788636814.497798:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226065152 00000100:00100000:3.0:1788636814.497823:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226065152 00000100:00100000:3.0:1788636814.497857:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788636814.497865:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875521226065152:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788636814.497879:0:6527:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788636814.497921:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875521226065152:12345-0@lo:38:kworker.0 Request processed in 55us (5654us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788636814.497927:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:3.0:1788636814.497954:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03a607000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788636814.497958:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788636814.497961:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226065152:0@lo:38:kworker.0 00000100:00080000:1.0:1788636814.504795:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788636814.504803:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788636814.504824:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636814.504832:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1788636814.504839:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788636814.504845:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cef03101800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636814.504867:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf01291a680 x1875521226065792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636814.504918:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226065792:0@lo:38:kworker.0 00000100:00100000:1.0:1788636814.504996:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636814.505061:0:11089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226065792 00000100:00100000:1.0:1788636814.505072:0:11089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226065792 00000100:00100000:1.0:1788636814.505118:0:11089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788636814.505127:0:11089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226065792:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788636814.505170:0:11089:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788636814.505216:0:11089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3645:x1875521226065792:12345-0@lo:38:kworker.0 Request processed in 89us (220us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788636814.505223:0:11089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:1.0:1788636814.505271:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636814.505276:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788636814.505280:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226065792:0@lo:38:kworker.0 00000100:00100000:3.0:1788636814.505501:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226065920:0@lo:400:kworker.0 00000100:00100000:3.0:1788636814.505541:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636814.505574:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636814.505590:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226065664:0@lo:400:kworker.0 00000100:00100000:3.0:1788636814.505615:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636814.505836:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226065920 00000100:00100000:0.0:1788636814.505843:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226065920 00000100:00100000:0.0:1788636814.505894:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1788636814.505901:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226065920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636814.505944:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226065920:12345-0@lo:400:kworker.0 Request processed in 43us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636814.505950:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00010000:00080000:0.0:1788636814.505975:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf012918e00 x1875521226065920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636814.505987:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226065920:0@lo:400:kworker.0 00000100:00080000:3.0:1788636814.506377:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636814.506541:0:9845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226065664 00000100:00100000:1.0:1788636814.506546:0:9845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226065664 00000100:00100000:1.0:1788636814.507829:0:9845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788636814.507846:0:9845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226065664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636814.507929:0:9845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226065664:12345-0@lo:400:kworker.0 Request processed in 90us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636814.507935:0:9845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1788636814.508130:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636814.508205:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226065664:0@lo:400:kworker.0 00000020:01000000:3.0:1788636814.741009:0:15213:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cef026829c0 - data ffff9cf01199e6c0/ffff9cef03492400 00000020:01000000:3.0:1788636814.741199:0:15213:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf0096fe900 - data ffff9cf011b1d0d8/ffff9cf015b26800 00000020:00000080:3.0:1788636814.741739:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837d23 00000020:00000080:3.0:1788636814.741748:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf008bef800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788636814.741769:0:15213:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf00324c000 from MGS, refs=2 00000020:01000004:3.0:1788636814.741773:0:15213:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00324c000 2 00000020:01000004:3.0:1788636814.741776:0:15213:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf00324c000 from MGS 00000020:00000080:3.0:1788636814.741799:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636814.741867:0:15213:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788636814.741870:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf008be9800/MGS 00000020:00000080:3.0:1788636814.741873:0:15213:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf008be9800/MGS for MGS 00000020:01000000:3.0:1788636814.741884:0:15213:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788636814.741957:0:15213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788636814.741962:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636814.741967:0:15213:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788636814.741973:0:15213:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9cf026969800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788636814.741978:0:15213:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9cf0056fb380) has exports, disconnecting them 00000020:00080000:3.0:1788636814.741983:0:15213:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9cf026969800), last request at 1788636510 00000020:00000080:3.0:1788636814.741987:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837dee 00000020:00080000:3.0:1788636814.741997:0:15213:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf026969800): rc 0 00000020:00000080:3.0:1788636814.742002:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf026969800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788636814.742696:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf008bef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788636814.742712:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf026969800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:00010000:1.0:1788636814.742744:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:2.0:1788636814.742869:0:15213:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788636814.742874:0:15213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788636814.742878:0:15213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788636814.742883:0:15213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788636814.743042:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636814.743048:0:15213:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788636814.743054:0:15213:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00324c000 1 00000020:00000080:2.0:1788636814.743059:0:15213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837d15 00000020:00000080:2.0:1788636814.743065:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf008be8000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788636814.743069:0:15213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788636814.743074:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636814.743077:0:15213:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788636814.743080:0:15213:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9cf0056f99c0) has no exports 00000020:00000080:1.0:1788636814.746728:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf02696b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788636814.746755:0:36:0:(genops.c:885:class_export_put()) final put ffff9cf0268f1000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788636814.746759:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0268f1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788636814.746771:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788636814.746918:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf008be8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788636814.884978:0:15213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788636814.884996:0:15213:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788636814.885005:0:15213:0:(genops.c:885:class_export_put()) final put ffff9cf00324d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788636814.885010:0:15213:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf00324d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788636814.885018:0:15213:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788636814.885160:0:15213:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cf00324b800 00000020:02000400:0.0:1788636814.885386:0:15213:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788636815.768638:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636816.798214:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636817.056011:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636817.056049:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226066048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788636817.056152:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636817.056221:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226066048 00000100:00100000:3.0:1788636817.056230:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226066048 00000100:00100000:3.0:1788636817.056298:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788636817.056324:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226066048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636817.056358:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788636817.056405:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226066048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636817.056412:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:3.0:1788636817.056443:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636817.056486:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226066048:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788636817.813681:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636818.837921:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788636819.127409:0:15416:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788636819.152038:0:15416:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788636819.152121:0:15416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.152139:0:15416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.152147:0:15416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.152155:0:15416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.152268:0:15416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788636819.152276:0:15416:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788636819.152318:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788636819.152324:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788636819.152333:0:15416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788636819.152353:0:15416:0:(import.c:65:import_set_state_nolock()) ffff9cf041845000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788636819.152361:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788636819.152363:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788636819.152368:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788636819.155318:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636819.155337:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636819.155457:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000030200 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636819.155462:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636819.155475:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636819.155624:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636819.155632:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788636819.155636:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788636819.155640:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788636819.155709:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636819.155716:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788636819.155823:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226066176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636819.155923:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636819.156040:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636819.156049:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf000030200/0x5b741ef42e838271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838278 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636819.156070:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636819.156073:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636819.156075:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636819.156099:0:14670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226066176 00000100:00100000:0.0:1788636819.156111:0:14670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226066176 00000100:00100000:0.0:1788636819.156176:0:14670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788636819.156187:0:14670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0339e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1875521226066176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788636819.156195:0:14670:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788636819 with bad export cookie 6589926188851100991 00010000:00010000:1.0:1788636819.156997:0:15416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.157020:0:15416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.157027:0:15416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.157054:0:15416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.157084:0:15416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636819.157091:0:15416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.157097:0:15416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.157103:0:15416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.157110:0:15416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636819.157111:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636819.157125:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636819.157136:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7200 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636819.157141:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.157141:0:15416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636819.157159:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636819.157168:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636819.157175:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788636819.157177:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788636819.157203:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636819.157219:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636819.157256:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636819.157265:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e83827f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838286 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636819.157283:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636819.157287:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636819.157294:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636819.157297:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636819.157305:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636819.157312:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636819.157318:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788636819.157320:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788636819.157323:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788636819.157339:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636819.157346:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636819.157352:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636819.157369:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153f600/0x5b741ef42e838159 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e838160 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636819.157385:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636819.157387:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636819.157389:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636819.157780:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226066304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636819.157858:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636819.157864:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636819.157882:0:15416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.157895:0:15416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636819.157903:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226066304 00010000:00010000:1.0:1788636819.157904:0:15416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636819.157912:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226066304 00000100:00100000:2.0:1788636819.157912:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636819.157923:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226066432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636819.157929:0:15416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636819.157953:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636819.157954:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788636819.157963:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875521226066304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636819.157969:0:15416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636819.157980:0:15416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00020000:3.0:1788636819.157983:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788636819 with bad export cookie 6589926188851100991 00010000:00010000:1.0:1788636819.157999:0:15416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158005:0:15416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158011:0:15416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158035:0:15416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788636819.158039:0:15416:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1788636819.158044:0:15416:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000100:00100000:3.0:1788636819.158052:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875521226066304:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (191us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788636819.158065:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000020:01000004:1.0:1788636819.158076:0:15416:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788636819.158080:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788636819.158084:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00100000:3.0:1788636819.158087:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226066432 00000020:00000080:1.0:1788636819.158090:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000100:00100000:3.0:1788636819.158094:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226066432 00000020:00080000:1.0:1788636819.158099:0:15416:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9cef033a1800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788636819.158107:0:15416:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9cf0320fa800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788636819.158111:0:15416:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9cf041984d40) has exports, disconnecting them 00000020:00080000:1.0:1788636819.158115:0:15416:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9cef033a1800), last request at 1788636814 00000100:00100000:3.0:1788636819.158122:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000020:00000080:1.0:1788636819.158126:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838121 00000100:00100000:3.0:1788636819.158131:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875521226066432:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788636819.158138:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788636819 with bad export cookie 6589926188851100991 00000100:00080000:1.0:1788636819.158144:0:15416:0:(import.c:65:import_set_state_nolock()) ffff9cef033a4000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788636819.158171:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1875521226066432:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (219us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788636819.158178:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1788636819.158298:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636819.158305:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158319:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f400 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636819.158322:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158331:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636819.158338:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636819.158343:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788636819.158345:0:8452:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788636819.158347:0:8452:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788636819.158381:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158386:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788636819.158437:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1788636819.158441:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636819.158451:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226066560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636819.158453:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153f400/0x5b741ef42e8384e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e8384ee expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158477:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636819.158482:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158488:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015991800 already unused, calling callback (ffffffffc1381c20) 00000100:00100000:3.0:1788636819.158494:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1788636819.158496:0:8452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158514:0:8452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636819.158522:0:8452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636819.158525:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226066560 10000000:01000000:1.0:1788636819.158529:0:8452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788636819.158532:0:8452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788636819.158535:0:8452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:3.0:1788636819.158539:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226066560 00010000:00010000:1.0:1788636819.158559:0:8452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636819.158569:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788636819.158573:0:8452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788636819.158579:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875521226066560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788636819.158587:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788636819 with bad export cookie 6589926188851100991 00010000:00010000:1.0:1788636819.158594:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158602:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015991800/0x5b741ef42e837e42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5b741ef42e837e49 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636819.158627:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636819.158630:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875521226066560:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (138us total) trans 0 rc -107/-107 00010000:00010000:1.0:1788636819.158631:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636819.158637:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636819.158646:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000020:00080000:1.0:1788636819.158662:0:15416:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cef033a1800): rc 0 00000020:00000080:1.0:1788636819.158667:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cef033a1800/lustre-MDT0001-lwp-OST0001_UUID 00000100:00100000:3.0:1788636819.158678:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226066688:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788636819.158685:0:15416:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9cf0320fa800), last request at 1788636814 00000020:00000080:1.0:1788636819.158693:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837ffb 00000100:00080000:1.0:1788636819.158703:0:15416:0:(import.c:65:import_set_state_nolock()) ffff9cf0268db800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788636819.158713:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636819.158721:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788636819.158735:0:15416:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf0320fa800): rc 0 00000020:00000080:1.0:1788636819.158747:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf0320fa800/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:3.0:1788636819.158754:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000004:00000080:1.0:1788636819.158757:0:15416:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb25401c1bae0 00000100:00080000:3.0:1788636819.158761:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9cf0320f9800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788636819.158772:0:3647:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788636819.158784:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788636819.158790:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1788636819.158861:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788636819.158878:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788636819.159745:0:15416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788636819.159755:0:15416:0:(import.c:65:import_set_state_nolock()) ffff9cf03a607000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1788636819.159870:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636819.159888:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226066688 00000100:00100000:1.0:1788636819.159900:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226066688 00000100:00100000:1.0:1788636819.160032:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788636819.160040:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1875521226066688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788636819.160046:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788636819 with bad export cookie 6589926188851100991 00000100:00100000:1.0:1788636819.160124:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1875521226066688:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1413us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788636819.160130:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000020:00000080:1.0:1788636819.161930:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef033a1800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788636819.162017:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0320fa800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788636819.162066:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef033a4000 for lustre-MDT0001 00000020:00000080:1.0:1788636819.162073:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf0268db800 for lustre-MDT0001 00000100:00100000:0.0:1788636819.162078:0:14670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0339e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1875521226066176:12345-0@lo:103:ldlm_bl.0 Request processed in 5883us (6147us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788636819.162096:0:14670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788636819.171192:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788636819.171200:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1788636819.171252:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788636819.174476:0:15416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788636819.174521:0:15416:0:(import.c:65:import_set_state_nolock()) ffff9cf032425000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788636819.174554:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788636819.174559:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788636819.174587:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788636819.174703:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226066816:0@lo:9:umount.0 00000100:00100000:1.0:1788636819.174780:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788636819.176975:0:15416:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788636819.177018:0:15416:0:(import.c:65:import_set_state_nolock()) ffff9cef0235b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788636819.177082:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9cf041984d40) has no exports 00000100:00100000:1.0:1788636819.178704:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226066944:0@lo:9:umount.0 00000100:00100000:1.0:1788636819.178790:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636819.178879:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226066816 00000100:00100000:1.0:1788636819.178887:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226066816 00000100:00100000:1.0:1788636819.178941:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226066944 00000100:00100000:1.0:1788636819.178951:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226066944 00000100:00100000:1.0:1788636819.178978:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788636819.179001:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875521226066816:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788636819.179031:0:8437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838048 00000100:00080000:1.0:1788636819.179041:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc18000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788636819.179087:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788636819.179303:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3645:x1875521226066816:12345-0@lo:9:umount.0 Request processed in 303us (4521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636819.179310:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788636819.179330:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788636819.179337:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875521226066944:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788636819.179353:0:8437:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e83818a 00000100:00080000:1.0:1788636819.179359:0:8437:0:(import.c:65:import_set_state_nolock()) ffff9cef03106000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788636819.179383:0:8437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788636819.179458:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3645:x1875521226066944:12345-0@lo:9:umount.0 Request processed in 121us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636819.179464:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788636819.179483:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636819.179487:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788636819.179503:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636819.179510:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788636819.179543:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef0235b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788636819.179550:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788636819.179553:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788636819.179556:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226066944:0@lo:9:umount.0 00000100:00080000:1.0:1788636819.179570:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032425000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788636819.179574:0:3645:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788636819.179576:0:3645:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788636819.179578:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226066816:0@lo:9:umount.0 00000100:00080000:3.0:1788636819.189326:0:3647:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.126@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788636819.189332:0:3647:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788636819.189343:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef040f3800 x1875521226065024/t0(0) o400->MGC192.168.202.126@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788636830 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636819.189379:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef0362ea00 x1875521226066176/t0(0) o103->MGC192.168.202.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788636835 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636819.189390:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf03fcac000 x1875521226066304/t0(0) o103->MGC192.168.202.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788636835 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636819.189400:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf03fcaed80 x1875521226066432/t0(0) o103->MGC192.168.202.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788636835 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636819.189409:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf03a9d4380 x1875521226066560/t0(0) o103->MGC192.168.202.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788636835 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636819.189418:0:3647:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf01291b800 x1875521226066688/t0(0) o103->MGC192.168.202.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788636835 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788636819.189434:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9cf0320f9800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:3.0:1788636819.189435:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788636819.189465:0:3647:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788636819.189468:0:3647:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788636819.189473:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9cf0320f9800 MGS: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788636819.189477:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226066304:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788636819.189482:0:3647:0:(import.c:545:import_select_connection()) MGC192.168.202.126@tcp: connect to NID 0@lo last attempt 179 00000100:00100000:0.0:1788636819.189485:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3646:1875521226065024:0@lo:400:kworker.0 00000100:00080000:3.0:1788636819.189497:0:3647:0:(import.c:665:import_select_connection()) MGC192.168.202.126@tcp: import ffff9cf0320f9800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636819.189633:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3648:1875521226066432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636819.190168:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcad880 x1875521226067072/t0(0) o250->MGC192.168.202.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788636819.190209:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226066176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636819.190229:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226066688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636819.190235:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3647:1875521226066560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636819.190608:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3645:1875521226067072:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1788636819.190682:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875521226067072 offset 0 length 520: 4 00000020:00080000:2.0:1788636819.208208:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9cf041984d40) has no exports 00000020:01000000:3.0:1788636819.282590:0:15416:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cef0315d900 - data ffff9cef01cc7948/ffff9cef0350ec00 00000020:01000000:3.0:1788636819.282868:0:15416:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf0124ebd20 - data ffff9cf031d64d80/ffff9cf03a76cc00 00000001:00000004:1.0:1788636819.313388:0:15416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788636819.402976:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788636819.402989:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788636819.403000:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788636819.421715:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788636819.421725:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1788636819.421754:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788636819.421757:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788636819.422903:0:8477:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788636819.422909:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788636819.422924:0:8477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788636819.423514:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788636819.423520:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788636819.423530:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788636819.423532:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788636819.423765:0:9839:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788636819.423770:0:9839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1788636819.423781:0:9839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788636819.424937:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837e65 00000020:00000080:3.0:1788636819.424951:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf041962800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788636819.425853:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf041962800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788636819.433037:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837e7a 00000020:00000080:3.0:1788636819.433055:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf041961800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788636819.433077:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788636819.433095:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636819.433104:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788636819.433108:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9cf0056fcd40) has no exports 00000020:00000080:2.0:1788636819.433278:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf041961800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1788636819.433288:0:15416:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788636819.433297:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838183 00000020:00000080:3.0:1788636819.433301:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf03fc62000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788636819.433315:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788636819.433319:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636819.433327:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788636819.433329:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9cef0323b380) has no exports 00000020:00000080:3.0:1788636819.433337:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e83817c 00000020:00000080:3.0:1788636819.433341:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cef0235c800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788636819.433371:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc62000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788636819.433377:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef0235c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788636819.437815:0:15416:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788636819.437828:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788636819.437833:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788636819.437841:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788636819.437844:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788636819.437914:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636819.437923:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef0235b800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788636819.437930:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788636819.437936:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cef033a5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788636819.437939:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef033a5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788636819.437946:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788636819.438041:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838041 00000020:00000080:3.0:1788636819.438048:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cef02081000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788636819.438065:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788636819.438069:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636819.438075:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788636819.438079:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9cef019d19c0) has no exports 00000020:00000080:3.0:1788636819.438086:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e83803a 00000020:00000080:3.0:1788636819.438090:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf03af90800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788636819.438127:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef02081000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788636819.438134:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03af90800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788636819.438500:0:15416:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788636819.438504:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788636819.438517:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1788636819.438521:0:15416:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788636819.438523:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788636819.438563:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636819.438569:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788636819.438589:0:15416:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788636819.438596:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837e9d 00000020:00000080:3.0:1788636819.438602:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf03a764800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788636819.438606:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788636819.438609:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636819.438613:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788636819.438627:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9cf041980000) has no exports 00000020:00000080:3.0:1788636819.438633:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837e96 00000020:00000080:3.0:1788636819.438636:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf03a601000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788636819.438890:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf032425000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788636819.438898:0:8:0:(genops.c:885:class_export_put()) final put ffff9cf03af94000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788636819.438900:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03af94000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788636819.438906:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788636819.438977:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a764800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788636819.438983:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a601000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788636819.441994:0:15416:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788636819.442008:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788636819.442014:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788636819.442027:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788636819.442194:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03a607000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788636819.443098:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636819.443120:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788636819.443128:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf03a601800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788636819.443133:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a601800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788636819.443144:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788636819.443451:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636819.443458:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788636819.443462:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf02696c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788636819.443465:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf02696c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788636819.443474:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788636819.443606:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837e81 00000020:00000080:2.0:1788636819.443616:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf041967800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788636819.443644:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788636819.443649:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636819.443654:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788636819.443658:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9cf0419819c0) has no exports 00000020:00000080:0.0:1788636819.443685:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf041967800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788636819.443688:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636819.443698:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788636819.443703:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf041963800/lustre-MDD0001_UUID 00000020:00000080:2.0:1788636819.443706:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf041963800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788636819.443713:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788636819.445016:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837e88 00000020:00000080:2.0:1788636819.445028:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf041965800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788636819.445075:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf041965800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:2.0:1788636819.445084:0:15416:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf00f150000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788636819.445102:0:15416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00f150000 2 00000020:01000004:2.0:1788636819.445106:0:15416:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf00f150000 from lustre-MDT0001 00000020:00000080:2.0:1788636819.445137:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636819.445143:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788636819.445146:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf041960800/lustre-MDT0001_UUID 00000020:00000080:2.0:1788636819.445148:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf041960800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788636819.445163:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788636819.445200:0:15416:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788636819.445204:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788636819.445208:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636819.445212:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788636819.445219:0:15416:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9cf03a888000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788636819.445225:0:15416:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9cf03a60cd40) has exports, disconnecting them 00000020:00080000:2.0:1788636819.445230:0:15416:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9cf03a888000), last request at 1788636530 00000020:00000080:2.0:1788636819.445234:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837edc 00000020:00080000:2.0:1788636819.445255:0:15416:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf03a888000): rc 0 00000020:00000080:2.0:1788636819.445259:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf03a888000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788636819.445300:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a888000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788636819.452999:0:15416:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788636819.453012:0:15416:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788636819.453018:0:15416:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788636819.453030:0:15416:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788636819.453071:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf041845000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788636819.453451:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788636819.453463:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788636819.453469:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf041842000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788636819.453474:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf041842000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788636819.453482:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788636819.453656:0:15416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00f150000 1 00000020:00000080:0.0:1788636819.453678:0:15416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837e18 00000020:00000080:0.0:1788636819.453688:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf00f1a6800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788636819.453700:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788636819.453709:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf00f1a6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788636819.453720:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788636819.453727:0:15416:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788636819.453731:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9cf032408000) has no exports 00000100:00080000:0.0:1788636819.609970:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2c4a4b8e-4887-46f1-83c2-b9af7c6766da->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788636819.609982:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2c4a4b8e-4887-46f1-83c2-b9af7c6766da->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636819.609986:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788636819.609990:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788636819.609995:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636819.610006:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 483 00000100:00080000:0.0:1788636819.610011:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788636819.610019:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cef02083000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636819.610074:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0362e680 x1875521226067200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636819.610129:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788636819.610133:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788636819.610134:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636819.610138:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 483 00000100:00080000:0.0:1788636819.610140:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788636819.610143:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cef03101800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636819.610151:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0362ca80 x1875521226067456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636819.610202:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226067200:0@lo:38:kworker.0 00000100:00100000:0.0:1788636819.610297:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636819.610347:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226067456:0@lo:38:kworker.0 00000100:00100000:0.0:1788636819.610366:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636819.610397:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226067584:0@lo:400:kworker.0 00000100:00100000:0.0:1788636819.610416:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636819.610431:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636819.610436:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226067328:0@lo:400:kworker.0 00000100:00100000:0.0:1788636819.610452:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636819.610487:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226067200 00000100:00100000:0.0:1788636819.610497:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226067200 00000100:00100000:0.0:1788636819.610539:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226067456 00000100:00100000:0.0:1788636819.610542:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226067456 00000100:00100000:0.0:1788636819.610550:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226067584 00000100:00100000:0.0:1788636819.610552:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226067584 00000100:00100000:0.0:1788636819.610564:0:13298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226067328 00000100:00100000:0.0:1788636819.610566:0:13298:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226067328 00000100:00100000:0.0:1788636819.610581:0:13298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788636819.610589:0:13298:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875521226067200:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788636819.610612:0:13298:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788636819.644952:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788636819.644967:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875521226067456:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788636819.644996:0:6522:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788636819.645102:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875521226067456:12345-0@lo:38:kworker.0 Request processed in 135us (34733us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788636819.645110:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788636819.645137:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788636819.645142:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875521226067584:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788636819.645148:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788636819.645179:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875521226067584:12345-0@lo:400:kworker.0 Request processed in 36us (34761us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788636819.645185:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788636819.645198:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788636819.645202:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875521226067328:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788636819.645207:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788636819.645261:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1875521226067328:12345-0@lo:400:kworker.0 Request processed in 56us (34807us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788636819.645267:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:0.0:1788636819.655997:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0000 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788636819.656006:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9cef02080000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788636819.656010:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788636819.666120:0:13298:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0337df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1875521226067200:12345-0@lo:38:kworker.0 Request processed in 55517us (55809us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788636819.666138:0:13298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1788636819.668914:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788636819.668931:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788636819.668936:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226067200:0@lo:38:kworker.0 00000100:00080000:3.0:1788636819.668948:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788636819.668951:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788636819.668953:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226067456:0@lo:38:kworker.0 00000100:00080000:0.0:1788636819.675523:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9cef02080000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636819.675542:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 224 00000100:00080000:0.0:1788636819.675555:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9cef02080000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636819.675602:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0237ce00 x1875521226067712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636819.675654:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226067328:0@lo:400:kworker.0 00000100:00100000:0.0:1788636819.675695:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875521226067712:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788636819.675797:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636819.675920:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226067712 00000100:00100000:0.0:1788636819.675929:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226067712 00000100:00100000:0.0:1788636819.675977:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788636819.675988:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875521226067712:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788636819.676015:0:6522:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788636819.676274:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875521226067712:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 287us (477us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788636819.676280:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1788636819.676475:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef02080000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636819.676480:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788636819.676482:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875521226067712:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788636819.676507:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0001-lwp-OST0001 of lustre-MDT0001_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788636819.676511:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc66000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788636819.676514:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788636819.676803:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc66000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636819.676829:0:3649:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 251 00000100:00080000:0.0:1788636819.676837:0:3649:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cf03fc66000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636819.676866:0:3649:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0237ce00 x1875521226067840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636819.676889:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226067584:0@lo:400:kworker.0 00000100:00100000:0.0:1788636819.676935:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875521226067840:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788636819.677107:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636819.677263:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226067840 00000100:00100000:3.0:1788636819.677269:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226067840 00000100:00100000:3.0:1788636819.677306:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788636819.677313:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875521226067840:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1788636819.677327:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788636819.677371:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875521226067840:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 58us (264us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788636819.677377:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:0.0:1788636819.677479:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc66000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636819.677484:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788636819.677487:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875521226067840:0@lo:38:ptlrpcd_00_03.0 00000020:00000080:3.0:1788636819.741682:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636819.741698:0:15416:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788636819.741704:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf032423000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788636819.741709:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf032423000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788636819.741723:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788636819.742016:0:15416:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cf00f153800 00000020:01000000:3.0:1788636819.742045:0:15416:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788636819.742066:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636819.742074:0:15416:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788636819.742078:0:15416:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9cf040b3cd40) has no exports 00000100:00100000:2.0:1788636819.742355:0:13298:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9cef03511c00:13298] 4 exiting: rc = 0 00000100:00100000:3.0:1788636819.742553:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9cf040933a00:6523] 2 exiting: rc = 0 00000100:00100000:0.0:1788636819.742850:0:11089:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9cef0354d800:11089] 3 exiting: rc = 0 00000100:00100000:0.0:1788636819.742937:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9cf0096ef800:6522] 1 exiting: rc = 0 00000100:00100000:2.0:1788636819.751097:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9cf040932000:6521] 0 exiting: rc = 1 00000100:00100000:0.0:1788636819.751282:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751292:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751298:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751304:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751309:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751315:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751320:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751325:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751330:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751335:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751340:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751345:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751351:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751356:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751361:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751367:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751375:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751380:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751387:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751392:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751398:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751404:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751409:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751415:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751436:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751441:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751450:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751455:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751459:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751465:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751471:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751477:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751483:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751488:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751495:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751501:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751507:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751513:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751518:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751524:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751529:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751534:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751539:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751545:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751550:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751556:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751561:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751566:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751573:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751578:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751584:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751589:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751595:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751601:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751606:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751611:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751616:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751622:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751627:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751640:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751645:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751652:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751658:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636819.751663:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636819.759555:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9cf012a11800:6525] 1 exiting: rc = 0 00000100:00100000:2.0:1788636819.759672:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9cf040933c00:6524] 0 exiting: rc = 1 00000100:00100000:1.0:1788636819.760222:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760232:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760239:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760258:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760265:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760271:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760278:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760283:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760290:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760297:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760303:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760310:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760318:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760324:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760329:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760334:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760339:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760345:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760350:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760355:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760360:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760365:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760371:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760377:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760384:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760390:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760397:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760404:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760410:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760417:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760424:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760430:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760436:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760441:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760445:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760473:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760478:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760483:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760487:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760492:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760498:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760504:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760523:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760529:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760534:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760540:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760545:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760549:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760555:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760560:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760565:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760570:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760576:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760581:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760586:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760591:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760595:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760600:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760604:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760610:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760615:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760620:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760626:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.760631:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636819.761335:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9cf018312400:6526] 0 exiting: rc = 1 00000100:00100000:2.0:1788636819.761451:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9cf003012800:6527] 1 exiting: rc = 0 00000100:00100000:2.0:1788636819.761542:0:7884:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9cf0031eb000:7884] 2 exiting: rc = 0 00000100:00100000:1.0:1788636819.761781:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761790:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761798:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761838:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761845:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761851:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761867:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761873:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761890:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761898:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761904:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761910:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761918:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761924:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761929:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761951:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761959:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761964:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761970:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761976:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761982:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761988:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.761995:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762002:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762008:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762014:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762020:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762040:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762048:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762054:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762061:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762067:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762074:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762079:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762085:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762091:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762098:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762107:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762117:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762137:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762145:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762157:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762163:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762169:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762175:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762181:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762187:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762193:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762199:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762204:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762210:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762230:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762237:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762256:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762263:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762270:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762276:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762281:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762287:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762293:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762299:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762305:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762310:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.762322:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.788340:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9cf040b9aa00:6528] 0 exiting: rc = 1 00000100:00100000:3.0:1788636819.788484:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9cf00911e800:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1788636819.790051:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790061:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790066:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790071:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790075:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790081:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790086:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790092:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790098:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790104:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790109:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790114:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790120:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790124:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790129:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790134:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790139:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790145:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790150:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790156:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790161:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790166:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790171:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790176:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790181:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790186:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790190:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790195:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790199:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790203:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790223:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790228:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790232:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790237:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790252:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790258:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790264:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790269:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790274:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790279:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790283:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790288:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790292:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790298:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790303:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790310:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790317:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790321:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790325:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790330:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790336:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790341:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790346:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790351:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790357:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790363:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790369:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790374:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790379:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790384:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790389:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790394:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790399:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.790404:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.790969:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9cf040b9ba00:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1788636819.791367:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9cf040b9a800:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1788636819.791457:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791464:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791469:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791474:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791478:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791483:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791488:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791492:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791497:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791503:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791534:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791541:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791547:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791552:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791558:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791563:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791569:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791574:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791580:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791586:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791591:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791596:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791601:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791606:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791611:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791615:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791622:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791627:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791633:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791638:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791644:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791649:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791655:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791660:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791667:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791673:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791678:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791684:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791689:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791695:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791700:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791705:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791710:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791716:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791721:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791733:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791739:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791744:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791749:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791754:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791759:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791763:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791769:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791774:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791779:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791784:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791789:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791794:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791800:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791832:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791839:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791845:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791850:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.791855:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.792364:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9cf003158000:6533] 1 exiting: rc = 0 00000100:00100000:0.0:1788636819.793170:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9cf040b9b800:6532] 0 exiting: rc = 1 00000100:00100000:1.0:1788636819.793292:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793299:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793305:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793310:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793315:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793320:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793325:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793330:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793337:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793342:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793347:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793352:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793357:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793362:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793367:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793388:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793393:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793399:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793404:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793409:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793414:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793420:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793425:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793429:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793434:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793439:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793444:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793449:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793455:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793459:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793464:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793469:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793474:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793478:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793483:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793487:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793492:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793497:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.793502:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794055:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794074:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794080:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794085:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794090:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794094:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794099:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794104:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794109:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794114:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794118:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794134:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794139:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794144:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794148:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794153:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794157:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794162:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794168:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794172:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794177:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794182:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794187:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794191:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.794196:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636819.794949:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9cf008493c00:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1788636819.795178:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9cf008492400:6536] 2 exiting: rc = 0 00000100:00100000:0.0:1788636819.795788:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9cf008493200:6535] 1 exiting: rc = 0 00000100:00100000:1.0:1788636819.796128:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796137:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796146:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796152:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796158:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796165:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796182:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796190:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796196:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796202:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796208:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796214:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796219:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796226:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796231:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796269:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796277:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796283:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796289:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796296:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796302:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796321:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796327:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796333:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796339:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796344:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796350:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796356:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796361:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796368:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796374:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796381:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796386:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796392:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796397:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796403:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796409:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796414:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796420:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796440:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796447:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796453:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796459:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796463:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796469:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796475:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796481:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796487:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796494:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796499:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796506:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796525:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796532:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796537:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796543:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796548:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796561:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796567:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796574:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796579:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796585:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796591:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796600:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636819.796607:0:15416:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788636819.817758:0:15416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636819.817773:0:15416:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788636819.817779:0:15416:0:(genops.c:885:class_export_put()) final put ffff9cf0320fc000/MDS_uuid 00000020:00000080:2.0:1788636819.817785:0:15416:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0320fc000/MDS_uuid for MDS 00000020:01000000:2.0:1788636819.817796:0:15416:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788636819.817972:0:15416:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788636819.863009:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636820.885940:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636821.909914:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636822.955018:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788636823.637623:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2c4a4b8e-4887-46f1-83c2-b9af7c6766da->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788636823.637638:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2c4a4b8e-4887-46f1-83c2-b9af7c6766da->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788636823.637642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788636823.637646:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788636823.637651:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788636823.637661:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1788636823.637667:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788636823.637676:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cef02083000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636823.637722:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef033bea00 x1875521226067968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788636823.637750:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788636823.637753:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788636823.637755:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cef02080000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788636823.637758:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1788636823.637762:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788636823.637765:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9cef02080000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636823.637775:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef033bd500 x1875521226068096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788636823.637783:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788636823.637786:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788636823.637788:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788636823.637791:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1788636823.637793:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788636823.637796:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cef03101800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636823.637846:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef033bd880 x1875521226068224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788636823.637854:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788636823.637858:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788636823.637859:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc66000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788636823.637862:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 488 00000100:00080000:2.0:1788636823.637864:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788636823.637867:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cf03fc66000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636823.637877:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef033bf100 x1875521226068352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636823.637952:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226067968:0@lo:38:kworker.0 00000400:00000100:0.0:1788636823.638020:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875521226067968 offset 0 length 520: 4 00000100:00100000:1.0:1788636823.638506:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875521226068096:0@lo:38:kworker.0 00000400:00000100:1.0:1788636823.638532:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875521226068096 offset 0 length 520: 4 00000100:00100000:1.0:1788636823.638546:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226068224:0@lo:38:kworker.0 00000400:00000100:1.0:1788636823.638562:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875521226068224 offset 0 length 520: 4 00000100:00100000:1.0:1788636823.638573:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875521226068352:0@lo:38:kworker.0 00000400:00000100:1.0:1788636823.638590:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875521226068352 offset 0 length 520: 4 00010000:00010000:1.0:1788636823.956896:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788636823.991013:0:15616:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788636824.008111:0:15616:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788636824.008167:0:15616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.008181:0:15616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.008189:0:15616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.008196:0:15616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.008236:0:15616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788636824.008241:0:15616:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788636824.008279:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788636824.008291:0:15616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef033bea00 x1875521226067968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788636848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636824.008308:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788636824.008313:0:15616:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788636824.008319:0:15616:0:(import.c:65:import_set_state_nolock()) ffff9cef02083000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788636824.008324:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788636824.008327:0:15616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef033bea00 x1875521226067968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788636848 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636824.008333:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788636824.008336:0:15616:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 32s for inflight to error out 00010000:00010000:2.0:1788636824.008387:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636824.008402:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636824.008410:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:2.0:1788636824.008414:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636824.008422:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636824.008429:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636824.008434:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788636824.008436:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788636824.008439:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788636824.008451:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf0320f9800 00010000:00010000:2.0:1788636824.008460:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636824.008466:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7800/0x5b741ef42e838255 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e83825c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636824.008476:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636824.008478:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636824.008480:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636824.008682:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226067968:0@lo:38:kworker.0 00000100:00080000:1.0:1788636824.010761:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788636824.010779:0:15616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef033bd500 x1875521226068096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788636838 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636824.010801:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788636824.010834:0:15616:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788636824.010840:0:15616:0:(import.c:65:import_set_state_nolock()) ffff9cef02080000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788636824.010846:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788636824.010850:0:15616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef033bd500 x1875521226068096/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788636838 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636824.010858:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788636824.010861:0:15616:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:0.0:1788636824.010989:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875521226068096:0@lo:38:kworker.0 00010000:00010000:1.0:1788636824.012318:0:15616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.012352:0:15616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.012359:0:15616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.012365:0:15616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.012491:0:15616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636824.012500:0:15616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.012507:0:15616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.012514:0:15616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636824.012521:0:15616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636824.012622:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788636824.012629:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636824.012637:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf015990e00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636824.012641:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636824.012650:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636824.012658:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636824.012664:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788636824.012667:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1788636824.012678:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf0320f9800 00010000:00010000:3.0:1788636824.012682:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636824.012699:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015990e00/0x5b741ef42e838263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e83826a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636824.012714:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636824.012717:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636824.012723:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153e800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636824.012726:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636824.012739:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636824.012746:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636824.012751:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788636824.012754:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788636824.012757:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf0320f9800 00010000:00010000:3.0:1788636824.012760:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636824.012767:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636824.012768:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636824.012770:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636824.012979:0:15616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788636824.012984:0:15616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153e800/0x5b741ef42e8384d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e8384e0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636824.012994:0:15616:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788636824.012997:0:15616:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788636824.012999:0:15616:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788636824.013030:0:15616:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788636824.013034:0:15616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788636824.013038:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788636824.013043:0:15616:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788636824.013050:0:15616:0:(genops.c:1819:print_export_data()) lustre-OST0000: UNLINKED ffff9cf03fc1c800 lustre-MDT0001-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967297 stale:0 00000020:00080000:1.0:1788636824.013057:0:15616:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9cef019d4d40) has no exports 00000020:00080000:1.0:1788636824.013077:0:15616:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9cef019d4d40) has no exports 00010000:00010000:2.0:1788636824.014528:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636824.981142:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788636825.239329:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788636825.239338:0:9516:0:(genops.c:885:class_export_put()) final put ffff9cef03100000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788636825.239493:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef03100000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788636825.239546:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef03106000 for lustre-OST0001 00000001:00100000:1.0:1788636825.243438:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788636825.243459:0:8431:0:(genops.c:885:class_export_put()) final put ffff9cf03fc1c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788636825.243625:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc1c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788636825.243676:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03fc18000 for lustre-OST0000 00010000:00010000:3.0:1788636826.005107:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788636826.068992:0:15616:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cef0315d360 - data ffff9cf031f4e438/ffff9cef0350c400 00000020:01000000:1.0:1788636826.069172:0:15616:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cef01a908a0 - data ffff9cf01199fa20/ffff9cf03aae3000 00100000:10000000:1.0:1788636826.085297:0:15616:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788636826.108053:0:15616:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837fb5 00000020:00000080:2.0:1788636826.108067:0:15616:0:(genops.c:885:class_export_put()) final put ffff9cf03af97000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788636826.108090:0:15616:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf00f1a3000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788636826.108094:0:15616:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00f1a3000 2 00000020:01000004:2.0:1788636826.108097:0:15616:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf00f1a3000 from lustre-OST0000 00000020:00000080:2.0:1788636826.108129:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636826.108140:0:15616:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788636826.108143:0:15616:0:(genops.c:885:class_export_put()) final put ffff9cf03af93000/lustre-OST0000_UUID 00000020:00000080:2.0:1788636826.108146:0:15616:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03af93000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788636826.108153:0:15616:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788636826.108202:0:15616:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788636826.108205:0:15616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788636826.108209:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636826.108213:0:15616:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788636826.108220:0:15616:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9cef02083800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788636826.108226:0:15616:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9cf03a6099c0) has exports, disconnecting them 00000020:00080000:2.0:1788636826.108242:0:15616:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9cef02083800), last request at 1788636555 00000020:00000080:2.0:1788636826.108245:0:15616:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837fdf 00000020:00080000:2.0:1788636826.108253:0:15616:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cef02083800): rc 0 00000020:00000080:2.0:1788636826.108268:0:15616:0:(genops.c:885:class_export_put()) final put ffff9cef02083800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788636826.108409:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03af97000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788636826.108421:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef02083800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788636826.110529:0:15616:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788636826.110541:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788636826.110547:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788636826.110556:0:15616:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788636826.110803:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636826.110835:0:15616:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788636826.110844:0:15616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788636826.110851:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636826.110856:0:15616:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788636826.110864:0:15616:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9cf0320fd000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788636826.110889:0:15616:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9cf03a608000) has exports, disconnecting them 00000020:00080000:3.0:1788636826.110895:0:15616:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9cf0320fd000), last request at 1788636555 00000020:00000080:3.0:1788636826.110900:0:15616:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837ff4 00000020:00080000:3.0:1788636826.110916:0:15616:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf0320fd000): rc 0 00000020:00000080:3.0:1788636826.110923:0:15616:0:(genops.c:885:class_export_put()) final put ffff9cf0320fd000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788636826.111204:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef02083000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788636826.111213:0:8:0:(genops.c:885:class_export_put()) final put ffff9cf03a762000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788636826.111217:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a762000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788636826.111236:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788636826.111317:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0320fd000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788636826.140929:0:15616:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788636826.140939:0:15616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788636826.140944:0:15616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788636826.140952:0:15616:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788636826.140984:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef02080000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788636826.141217:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788636826.141227:0:15616:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788636826.141233:0:15616:0:(genops.c:885:class_export_put()) final put ffff9cef02086800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788636826.141238:0:15616:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef02086800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788636826.141247:0:15616:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788636826.141329:0:15616:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00f1a3000 1 00000020:00000080:1.0:1788636826.141345:0:15616:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837f7d 00000020:00000080:1.0:1788636826.141351:0:15616:0:(genops.c:885:class_export_put()) final put ffff9cf00f1a4000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788636826.141360:0:15616:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788636826.141368:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf00f1a4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788636826.141378:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788636826.141382:0:15616:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788636826.141385:0:15616:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9cf040b399c0) has no exports 00000020:00000080:1.0:1788636826.343843:0:15616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788636826.343859:0:15616:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788636826.343866:0:15616:0:(genops.c:885:class_export_put()) final put ffff9cf00f1a2000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788636826.343870:0:15616:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf00f1a2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788636826.343883:0:15616:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788636826.343999:0:15616:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cf00f1a7800 00000020:02000400:1.0:1788636826.344053:0:15616:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788636827.034249:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636828.053054:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788636828.821290:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2c4a4b8e-4887-46f1-83c2-b9af7c6766da->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788636828.821300:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2c4a4b8e-4887-46f1-83c2-b9af7c6766da->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636828.821303:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788636828.821307:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636828.821310:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788636828.821313:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788636829.076945:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636829.780947:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636819/real 1788636819] req@ffff9cf03fcad880 x1875521226067072/t0(0) o250->MGC192.168.202.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788636829 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636829.780984:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf03fcad880 x1875521226067072/t0(0) o250->MGC192.168.202.126@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788636829 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788636829.781042:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf0320f9800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636829.781065:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788636829.781070:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3645:1875521226067072:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1788636829.781232:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2c4a4b8e-4887-46f1-83c2-b9af7c6766da->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788636829.781237:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788636829.781240:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cf0320f9800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788636829.781245:0:8:0:(import.c:545:import_select_connection()) MGC192.168.202.126@tcp: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1788636829.781251:0:8:0:(import.c:630:import_select_connection()) MGC192.168.202.126@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788636829.781258:0:8:0:(import.c:665:import_select_connection()) MGC192.168.202.126@tcp: import ffff9cf0320f9800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636829.781301:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef033bf800 x1875521226068480/t0(0) o250->MGC192.168.202.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788636829.781318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788636829.781322:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788636829.781325:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788636829.781329:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788636829.781395:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3645:1875521226068480:0@lo:250:kworker.0 00000400:00000100:0.0:1788636829.781442:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875521226068480 offset 0 length 520: 4 00010000:00010000:3.0:1788636830.107050:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788636830.387533:0:15817:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788636830.413688:0:15817:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788636830.413776:0:15817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636830.413792:0:15817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636830.413800:0:15817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636830.414018:0:15817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636830.414040:0:15817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788636830.414045:0:15817:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788636830.414072:0:15817:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788636830.414083:0:15817:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef033bd880 x1875521226068224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788636848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636830.414103:0:15817:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788636830.414108:0:15817:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788636830.414114:0:15817:0:(import.c:65:import_set_state_nolock()) ffff9cef03101800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788636830.414143:0:15817:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788636830.414148:0:15817:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef033bd880 x1875521226068224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788636848 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636830.414156:0:15817:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:2.0:1788636830.414170:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636830.414182:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636830.414191:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000030600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:2.0:1788636830.414196:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636830.414205:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636830.414219:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636830.414225:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788636830.414227:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788636830.414230:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788636830.414242:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf0320f9800 00010000:00010000:2.0:1788636830.414246:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636830.414252:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf000030600/0x5b741ef42e838239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e838240 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636830.414263:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636830.414265:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636830.414267:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636830.414312:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226068224:0@lo:38:kworker.0 00000100:00100000:3.0:1788636830.416354:0:15817:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788636830.417625:0:15817:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788636830.417639:0:15817:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef033bf100 x1875521226068352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788636838 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636830.417662:0:15817:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788636830.417668:0:15817:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788636830.417673:0:15817:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc66000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788636830.417679:0:15817:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788636830.417682:0:15817:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef033bf100 x1875521226068352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788636838 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636830.417689:0:15817:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788636830.417692:0:15817:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:1.0:1788636830.417771:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875521226068352:0@lo:38:kworker.0 00010000:00010000:0.0:1788636830.419440:0:15817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636830.419456:0:15817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636830.419464:0:15817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636830.419488:0:15817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636830.420283:0:15817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636830.420642:0:15817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636830.420653:0:15817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636830.420660:0:15817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636830.420667:0:15817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636830.424122:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788636830.424135:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636830.424147:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000030000 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636830.424152:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636830.424162:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636830.424171:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636830.424177:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788636830.424179:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788636830.424193:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf0320f9800 00010000:00010000:3.0:1788636830.424196:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636830.424202:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf000030000/0x5b741ef42e838247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e83824e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636830.424288:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636830.424295:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636830.424301:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153e200 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:2.0:1788636830.424304:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636830.424312:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636830.424319:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636830.424345:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788636830.424347:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788636830.424352:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf0320f9800 00010000:00010000:2.0:1788636830.424355:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636830.424362:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636830.424364:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636830.424366:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636830.424517:0:15817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788636830.424525:0:15817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf00153e200/0x5b741ef42e8384cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e8384d2 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636830.424541:0:15817:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788636830.424547:0:15817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788636830.424549:0:15817:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788636830.424586:0:15817:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788636830.424590:0:15817:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:3.0:1788636830.424647:0:8452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788636830.426079:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788636830.426090:0:15817:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788636830.426095:0:15817:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9cef02720000) has no exports 00000020:00080000:1.0:1788636830.426121:0:15817:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9cef02720000) has no exports 00000020:01000000:1.0:1788636830.429466:0:15817:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cef02682de0 - data ffff9cf031deebd0/ffff9cef03491c00 00000020:01000000:1.0:1788636830.429641:0:15817:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cef0315d960 - data ffff9cef01c85288/ffff9cef03462c00 00100000:10000000:1.0:1788636830.454952:0:15817:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788636830.468568:0:15817:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e8380db 00000020:00000080:0.0:1788636830.468579:0:15817:0:(genops.c:885:class_export_put()) final put ffff9cf0268f6800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788636830.468629:0:15817:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf03a765800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788636830.468633:0:15817:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf03a765800 2 00000020:01000004:0.0:1788636830.468644:0:15817:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf03a765800 from lustre-OST0001 00000020:00000080:0.0:1788636830.468670:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788636830.468679:0:15817:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788636830.468683:0:15817:0:(genops.c:885:class_export_put()) final put ffff9cf03a88a000/lustre-OST0001_UUID 00000020:00000080:0.0:1788636830.468685:0:15817:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a88a000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788636830.468692:0:15817:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788636830.468873:0:15817:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2c4a4b8e-4887-46f1-83c2-b9af7c6766da->MGS 00010000:00010000:0.0:1788636830.468890:0:15817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf015991600/0x5b741ef42e837e34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e837e3b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636830.468902:0:15817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf015991600/0x5b741ef42e837e34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e837e3b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636830.468909:0:15817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788636830.468912:0:15817:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788636830.468915:0:15817:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788636830.468929:0:15817:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf0320f9800 00010000:00010000:0.0:1788636830.468933:0:15817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf015991600/0x5b741ef42e837e34 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e837e3b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636830.468947:0:15817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6a00/0x5b741ef42e8382a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5b741ef42e8382b0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636830.468954:0:15817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6a00/0x5b741ef42e8382a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5b741ef42e8382b0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636830.468959:0:15817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788636830.468962:0:15817:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788636830.468963:0:15817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788636830.468971:0:15817:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf0320f9800 00010000:00010000:0.0:1788636830.468973:0:15817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6a00/0x5b741ef42e8382a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5b741ef42e8382b0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788636830.468997:0:15817:0:(import.c:65:import_set_state_nolock()) ffff9cf0320f9800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788636830.469001:0:15817:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788636830.469003:0:15817:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788636830.469005:0:15817:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788636830.469009:0:15817:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788636830.469018:0:15817:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cef033bf800 x1875521226068480/t0(0) o250->MGC192.168.202.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788636844 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788636830.469207:0:15817:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788636830.469210:0:15817:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000020:00000080:3.0:1788636830.476031:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0268f6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788636830.476223:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2c4a4b8e-4887-46f1-83c2-b9af7c6766da:3645:1875521226068480:0@lo:250:kworker.0 10000000:01000000:0.0:1788636830.476309:0:15817:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788636830.476321:0:15817:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e837d31 00000020:00000080:0.0:1788636830.476329:0:15817:0:(genops.c:885:class_export_put()) final put ffff9cf0320ff800/2c4a4b8e-4887-46f1-83c2-b9af7c6766da 00000020:01000000:0.0:1788636830.476349:0:15817:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.126@tcp (flags='') 00000020:00000080:0.0:1788636830.476355:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788636830.476363:0:15817:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.126@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788636830.476367:0:15817:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9cf040b3b380) has no exports 00000020:00000080:1.0:1788636830.476462:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0320ff800/2c4a4b8e-4887-46f1-83c2-b9af7c6766da for MGC192.168.202.126@tcp 10000000:01000000:3.0:1788636830.476550:0:6519:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788636830.476651:0:15817:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.126@tcp: client import never connected 00000100:00080000:0.0:1788636830.476655:0:15817:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788636830.476658:0:15817:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788636830.476661:0:15817:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788636830.476663:0:15817:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788636830.476707:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788636830.476713:0:15817:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.126@tcp (uuid 2c4a4b8e-4887-46f1-83c2-b9af7c6766da) 00000020:01000000:0.0:1788636830.476720:0:15817:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788636830.476723:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788636830.476726:0:15817:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788636830.476731:0:15817:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9cef03102000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788636830.476737:0:15817:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9cf041983380) has exports, disconnecting them 00000020:00080000:0.0:1788636830.476741:0:15817:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9cef03102000), last request at 1788636582 00000020:00000080:0.0:1788636830.476754:0:15817:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e838105 00000020:00080000:0.0:1788636830.476771:0:15817:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cef03102000): rc 0 00000020:00000080:0.0:1788636830.476775:0:15817:0:(genops.c:885:class_export_put()) final put ffff9cef03102000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788636830.477702:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf0320f9800 for MGC192.168.202.126@tcp 00000020:00000080:1.0:1788636830.477712:0:8:0:(genops.c:885:class_export_put()) final put ffff9cf0320fd800/2c4a4b8e-4887-46f1-83c2-b9af7c6766da 00000020:00000080:1.0:1788636830.477715:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0320fd800/2c4a4b8e-4887-46f1-83c2-b9af7c6766da for MGC192.168.202.126@tcp 00000020:01000000:1.0:1788636830.477720:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.126@tcp (2c4a4b8e-4887-46f1-83c2-b9af7c6766da) 00000020:00000080:1.0:1788636830.478423:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef03102000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788636830.479948:0:15817:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788636830.479956:0:15817:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788636830.479960:0:15817:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788636830.479966:0:15817:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788636830.480138:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788636830.480147:0:15817:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788636830.480154:0:15817:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788636830.480158:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788636830.480162:0:15817:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788636830.480168:0:15817:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9cf03a767800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788636830.480175:0:15817:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9cef019d3380) has exports, disconnecting them 00000020:00080000:1.0:1788636830.480179:0:15817:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9cf03a767800), last request at 1788636582 00000020:00000080:1.0:1788636830.480183:0:15817:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e83811a 00000020:00080000:1.0:1788636830.480197:0:15817:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf03a767800): rc 0 00000020:00000080:1.0:1788636830.480201:0:15817:0:(genops.c:885:class_export_put()) final put ffff9cf03a767800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788636830.480995:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cef03101800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788636830.481006:0:8:0:(genops.c:885:class_export_put()) final put ffff9cef02358000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788636830.481009:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cef02358000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788636830.481015:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788636830.481084:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a767800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788636830.487940:0:15817:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788636830.487950:0:15817:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788636830.487954:0:15817:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788636830.487962:0:15817:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788636830.487990:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cf03fc66000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788636830.490491:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788636830.491865:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788636830.491950:0:8452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788636830.492126:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9cf0159e6c00:6505] 1 exiting: rc = 0 00000100:00100000:1.0:1788636830.512368:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9cf016b2ba00:6504] 0 exiting: rc = 1 00000100:00100000:3.0:1788636830.512675:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636830.513297:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9cf0124ed200:6506] 0 exiting: rc = 1 00000100:00100000:1.0:1788636830.513369:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9cf0034e6000:6507] 1 exiting: rc = 0 00000100:00100000:0.0:1788636830.515666:0:14670:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9cf0067f5200:14670] 3 exiting: rc = 0 00000100:00100000:1.0:1788636830.518829:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9cf00578c800:6508] 2 exiting: rc = 0 00000100:00100000:2.0:1788636830.519029:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519039:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519045:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519051:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519056:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519061:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519068:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519074:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519079:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519085:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519091:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519095:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519112:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519120:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519126:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519132:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519139:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519144:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519150:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519156:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519162:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519167:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519189:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519194:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519199:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519205:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519210:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519214:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519220:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519225:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519231:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519237:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519242:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519247:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519253:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519259:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519265:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519269:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519283:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519289:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519295:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519300:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519309:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519315:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519320:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519325:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519330:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519335:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519340:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519345:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519350:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519355:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519360:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.519364:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.520174:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.520182:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.520187:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.520199:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.520209:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.520214:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.520219:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.520225:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.520230:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.520235:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788636830.522452:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636830.522464:0:15817:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788636830.522471:0:15817:0:(genops.c:885:class_export_put()) final put ffff9cf03fc60800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788636830.522475:0:15817:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc60800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788636830.522484:0:15817:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788636830.522541:0:15817:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf03a765800 1 00000020:00000080:2.0:1788636830.522547:0:15817:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5b741ef42e8380aa 00000020:00000080:2.0:1788636830.522553:0:15817:0:(genops.c:885:class_export_put()) final put ffff9cf03fc66800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788636830.522570:0:15817:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788636830.522574:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636830.522579:0:15817:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788636830.522583:0:15817:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9cf03a60b380) has no exports 00000020:00000080:3.0:1788636830.523722:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03fc66800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788636830.559066:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636830.559082:0:15817:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788636830.559089:0:15817:0:(genops.c:885:class_export_put()) final put ffff9cf03a761800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788636830.559094:0:15817:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf03a761800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788636830.559107:0:15817:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788636830.559482:0:15817:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cf03a764000 00000020:01000000:2.0:1788636830.559513:0:15817:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788636830.559518:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636830.559522:0:15817:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788636830.559527:0:15817:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9cf040b38000) has no exports 00000020:00000080:2.0:1788636830.559562:0:15817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636830.559568:0:15817:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788636830.559572:0:15817:0:(genops.c:885:class_export_put()) final put ffff9cf041846800/OSS_uuid 00000020:00000080:2.0:1788636830.559574:0:15817:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf041846800/OSS_uuid for OSS 00000020:01000000:2.0:1788636830.559587:0:15817:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788636830.559730:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9cf040b97600:8437] 1 exiting: rc = 0 00000100:00080000:1.0:1788636830.559877:0:6517:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788636830.559983:0:9845:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9cef0338a800:9845] 3 exiting: rc = 0 00000100:00100000:0.0:1788636830.560104:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9cf03a8e7600:8438] 2 exiting: rc = 0 00000100:00100000:0.0:1788636830.560161:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9cf03a921a00:8436] 0 exiting: rc = 1 00000100:00100000:0.0:1788636830.560214:0:9847:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9cef019c1e00:9847] 4 exiting: rc = 0 00000100:00100000:2.0:1788636830.560508:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560519:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560526:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560532:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560538:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560543:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560548:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560554:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560559:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560564:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560570:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560575:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560581:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560586:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560591:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560596:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560601:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560606:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560611:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560616:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560621:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560626:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560631:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560636:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560641:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560645:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560650:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560655:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560661:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560665:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560671:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560675:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560680:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560685:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560699:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560704:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560709:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560715:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560719:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560724:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560729:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560735:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560740:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560745:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560750:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560755:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560759:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560764:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560769:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560775:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560780:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560785:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560791:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560796:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560801:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560838:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560845:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560850:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560856:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560860:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560865:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560870:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560876:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.560886:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636830.569717:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9cf026aa5c00:8440] 1 exiting: rc = 0 00000100:00100000:1.0:1788636830.569852:0:12473:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9cf03ab9bc00:12473] 2 exiting: rc = 0 00000100:00100000:0.0:1788636830.570007:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9cf032401800:8439] 0 exiting: rc = 1 00000100:00100000:2.0:1788636830.570170:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570185:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570192:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570198:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570203:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570221:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570226:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570231:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570236:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570241:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570246:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570251:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570256:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570262:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570268:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570284:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570291:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570296:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570301:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570306:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570322:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570328:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570333:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570339:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570344:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570349:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570354:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570359:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570363:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570368:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570374:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570379:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570385:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570390:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570396:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570402:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570407:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570412:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570418:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570423:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570437:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570442:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570447:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570453:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570458:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570482:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570489:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570493:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570498:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570503:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570508:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570513:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570518:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570523:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570527:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570532:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570538:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570543:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570548:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570553:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570559:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570564:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570569:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.570581:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636830.571794:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9cf026aeea00:8441] 0 exiting: rc = 1 00000100:00100000:0.0:1788636830.571992:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9cf026aefc00:8443] 2 exiting: rc = 0 00000100:00100000:1.0:1788636830.572288:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9cf00f192800:8442] 1 exiting: rc = 0 00000100:00100000:2.0:1788636830.573786:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.573797:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575244:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575256:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575262:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575268:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575288:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575295:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575302:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575307:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575313:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575333:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575338:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575344:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575349:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575355:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575361:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575367:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575374:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575380:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575385:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575391:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575397:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575402:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575408:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575414:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575444:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575452:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575458:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575463:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575469:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575474:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575479:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575486:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575493:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575499:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575504:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575509:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575515:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575521:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575526:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575532:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575538:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575544:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575550:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575555:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575569:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575574:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575581:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575587:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575607:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575615:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575621:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575626:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575632:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575637:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575643:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575648:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575654:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575660:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575666:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575672:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575678:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.575693:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.583378:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9cf040974a00:8444] 0 exiting: rc = 1 00000100:00100000:3.0:1788636830.584935:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9cf026aee800:8445] 1 exiting: rc = 0 00000100:00100000:2.0:1788636830.585070:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585077:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585082:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585087:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585091:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585097:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585103:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585107:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585112:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585117:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585124:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585129:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585133:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585138:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585143:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585148:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585167:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585172:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585177:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585182:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585187:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585191:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585196:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585201:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585206:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585211:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585216:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585226:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585231:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585236:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585240:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585246:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585251:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585256:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585261:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585266:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585271:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585295:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585302:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585317:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585324:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585329:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585334:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585339:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585345:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585350:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585355:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585360:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585366:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585371:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585377:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585390:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585396:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585401:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585406:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585411:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585428:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585436:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585442:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585447:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585452:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585457:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585463:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.585474:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636830.586415:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9cf03ad10400:8446] 0 exiting: rc = 1 00000100:00100000:3.0:1788636830.586495:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9cf03ab79800:8447] 1 exiting: rc = 0 00000100:00100000:2.0:1788636830.586856:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586863:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586870:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586876:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586882:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586888:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586895:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586900:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586906:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586912:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586918:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586923:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586943:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586951:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586956:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586962:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586968:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586974:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586980:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586986:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586992:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.586997:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587015:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587020:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587042:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587049:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587054:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587061:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587067:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587072:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587077:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587083:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587089:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587093:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587099:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587105:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587126:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587133:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587139:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587145:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587150:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587155:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587170:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587178:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587185:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587197:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587203:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587210:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587216:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587223:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587230:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587236:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587242:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587249:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587271:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587289:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587294:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587463:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587475:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587481:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587488:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587493:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587499:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636830.587512:0:15817:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788636830.612890:0:15817:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788636853.956457:0:16582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788636867.368933:0:17183:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788636867.368940:0:17183:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788636867.368942:0:17183:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788636867.369445:0:17183:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cef03105000 00000020:01000004:3.0:1788636867.369462:0:17183:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788636867.369469:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788636867.369497:0:17183:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9cef034b3380) 00000020:00000080:3.0:1788636867.369509:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788636867.514864:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788636867.518862:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788636867.533301:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788636867.534214:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788636867.536258:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788636867.537326:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788636867.538252:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788636867.539091:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788636867.539787:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788636867.540434:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788636867.540865:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788636867.542488:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788636867.548043:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788636867.550247:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788636867.550966:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788636867.563956:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788636867.564431:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788636867.564907:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788636867.565290:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788636867.565585:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788636867.565913:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788636867.566292:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788636867.566594:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788636867.566778:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788636867.573779:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788636867.574939:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788636867.575948:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788636867.576641:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788636867.577553:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788636867.578333:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788636867.578762:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788636867.579433:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788636867.579841:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788636867.580639:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788636867.580916:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788636867.582433:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788636867.583106:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788636867.583688:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788636867.584327:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788636867.584983:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788636867.585635:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788636867.586296:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788636867.586616:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788636867.587073:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788636867.587932:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788636867.588734:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788636867.589393:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788636867.594310:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788636867.605086:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788636867.605747:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788636867.609508:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788636867.610159:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788636867.610593:0:17183:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:3.0:1788636867.616721:0:17183:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788636867.619014:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788636867.619023:0:17183:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788636867.619036:0:17183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e8392ee 00000020:01000004:3.0:1788636867.619045:0:17183:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788636867.619050:0:17183:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788636867.619054:0:17183:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cef03105000 from MGS 00000020:01000004:3.0:1788636867.619057:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788636867.619070:0:17183:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9cef034b4d40) 00000020:00000080:3.0:1788636867.619080:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788636867.619136:0:17183:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cef03105000 from MGS, refs=2 00080000:01000000:3.0:1788636867.619141:0:17183:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788636867.619145:0:17183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e8392fc 00000100:00100000:3.0:1788636867.619256:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788636867.619396:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788636867.619403:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788636867.624158:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788636867.624176:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788636867.627280:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788636867.630283:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788636867.630299:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788636867.636458:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788636867.636727:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788636867.642704:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788636867.642945:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788636867.645704:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636867.645710:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636867.645713:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636867.647773:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636867.647779:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636867.647781:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636867.648504:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788636867.652249:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788636867.677285:0:17183:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788636867.679830:0:17195:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788636867.679940:0:17183:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788636867.680069:0:17183:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788636867.680721:0:17183:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788636867.681735:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636867.683147:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788636867.683156:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788636867.693710:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788636867.693724:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788636867.694546:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788636867.694556:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788636867.695644:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788636867.695666:0:17183:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.126@tcp' 00000020:01000004:0.0:1788636867.695668:0:17183:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788636867.695699:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.126@tcp (typ=mgc) 00000020:00000080:0.0:1788636867.695713:0:17183:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.126@tcp (ffff9cf040bc19c0) 00000020:00000080:0.0:1788636867.695733:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788636867.695855:0:17183:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef0406b000@MGC192.168.202.126@tcp: add connection 192.168.202.126@tcp at head 00010000:00010000:0.0:1788636867.696196:0:17183:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.126@tcp-0 is initialized 00000040:01000000:0.0:1788636867.696210:0:17183:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.126@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788636867.696715:0:17201:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788636867.696781:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.126@tcp (uuid c7a34533-966f-4857-8403-9471b802ebf2) 00000020:00000080:1.0:1788636867.696798:0:17183:0:(genops.c:1385:class_connect()) connect: client c7a34533-966f-4857-8403-9471b802ebf2, cookie 0x5b741ef42e83930a 00000100:00080000:1.0:1788636867.696835:0:17183:0:(import.c:545:import_select_connection()) MGC192.168.202.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636867.696842:0:17183:0:(import.c:665:import_select_connection()) MGC192.168.202.126@tcp: import ffff9cef0406b000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636867.696876:0:17183:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf012919f80 x1875521226068608/t0(0) o250->MGC192.168.202.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636867.696899:0:17183:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c7a34533-966f-4857-8403-9471b802ebf2->MGS 00000020:01000004:1.0:1788636867.696920:0:17183:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788636867.696925:0:17183:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788636867.696937:0:17183:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9cef02723380) 00000020:00000080:1.0:1788636867.696947:0:17183:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788636867.697201:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7a34533-966f-4857-8403-9471b802ebf2:3645:1875521226068608:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788636867.697270:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636867.697346:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226068608 00000100:00100000:0.0:1788636867.697352:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226068608 00000100:00100000:0.0:1788636867.697391:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636867.697398:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3645:x1875521226068608:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788636867.697419:0:17196:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c7a34533-966f-4857-8403-9471b802ebf2@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1788636867.697439:0:17196:0:(genops.c:1385:class_connect()) connect: client c7a34533-966f-4857-8403-9471b802ebf2, cookie 0x5b741ef42e839318 00000100:00080000:0.0:1788636867.697568:0:17196:0:(import.c:65:import_set_state_nolock()) ffff9cef04068800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636867.697618:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+5:3645:x1875521226068608:12345-0@lo:250:mount.lustre.0 Request processed in 219us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636867.697626:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636867.697666:0:3645:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788636867.697674:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.126@tcp: connect to target with instance 0 00000100:00080000:0.0:1788636867.697682:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788636867.697686:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788636867.697689:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef0406b000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788636867.697691:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788636867.697698:0:3645:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788636867.697703:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c7a34533-966f-4857-8403-9471b802ebf2:3645:1875521226068608:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1788636867.698546:0:17200:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1788636867.725391:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788636867.726370:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788636867.727489:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788636867.730415:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788636867.730429:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788636867.731559:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788636867.731569:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788636867.732611:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636867.732757:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788636867.732760:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788636867.734553:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788636867.734561:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788636867.794402:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788636867.794752:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788636867.794759:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788636867.796352:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788636867.796365:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788636867.797750:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788636867.798313:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788636867.798320:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788636867.800704:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788636867.800720:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788636867.801678:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636867.802059:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788636867.802065:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788636867.802584:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788636867.802592:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788636867.804348:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788636867.804585:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788636867.804599:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788636867.805460:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788636867.805469:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788636867.835690:0:17183:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636867.836556:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788636867.836561:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788636867.838390:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788636867.838404:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788636867.839930:0:17183:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788636867.839944:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788636867.841288:0:17183:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788636867.841321:0:17183:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788636867.841329:0:17183:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788636867.841453:0:17183:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788636867.841570:0:17183:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.126@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788636867.841575:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788636867.841576:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636867.841577:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636867.841578:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636867.841579:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636867.841580:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636867.841581:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636867.841583:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636867.841584:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636867.841585:0:17183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788636867.841588:0:17183:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788636867.841590:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788636867.841591:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636867.841592:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636867.841593:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636867.841594:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636867.841595:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636867.841596:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636867.841597:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636867.841598:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636867.841599:0:17183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788636867.841636:0:17183:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788636867.841656:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226068736:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788636867.841733:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636867.842321:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571780 going to sleep for 11 seconds 00000100:00100000:2.0:1788636867.842578:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226068736 00000100:00100000:2.0:1788636867.842587:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226068736 00000100:00100000:2.0:1788636867.842683:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636867.842695:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+5:17183:x1875521226068736:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788636867.842748:0:17199:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788636867.842752:0:17199:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788636867.842756:0:17199:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788636867.843262:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788636867.843770:0:17199:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788636867.845671:0:17221:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788636867.845677:0:17221:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788636867.845688:0:17221:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788636867.845691:0:17221:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788636867.846092:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788636867.846401:0:17199:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788636867.846412:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788636867.853345:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+5:17183:x1875521226068736:12345-0@lo:253:mount.lustre.0 Request processed in 10642us (11602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636867.853361:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636867.853579:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226068736:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788636867.853597:0:17183:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788636867.853601:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788636867.853602:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636867.853604:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636867.853605:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636867.853606:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636867.853607:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636867.853609:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636867.853610:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636867.853613:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636867.853615:0:17183:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788636867.853640:0:17183:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cef03105000 from lustre-MDT0000 10000000:01000000:0.0:1788636867.853669:0:17183:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788636867.853672:0:17183:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788636867.853676:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cf040bc19c0 10000000:01000000:0.0:1788636867.853680:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788636867.853688:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf040bc19c0 from 1 10000000:01000000:0.0:1788636867.853691:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788636867.853729:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636867.853740:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636867.853750:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636867.853770:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226068864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788636867.853919:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636867.853973:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0061fc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788636867.854200:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226068864 00000100:00100000:1.0:1788636867.854208:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226068864 00000100:00100000:1.0:1788636867.854253:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788636867.854261:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+5:17183:x1875521226068864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636867.854275:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636867.854290:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab36600/0x5b741ef42e839326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83931f expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636867.854314:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab36600/0x5b741ef42e839326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83931f expref: 6 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636867.854325:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab36600/0x5b741ef42e839326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83931f expref: 6 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636867.854334:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36600, rc 0) 00000100:00100000:1.0:1788636867.854392:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+6:17183:x1875521226068864:12345-0@lo:101:mount.lustre.0 Request processed in 132us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636867.854399:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788636867.854574:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226068864:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636867.854590:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636867.854600:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636867.854673:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226068992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636867.854701:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636867.854728:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008ab7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636867.854791:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226068992 00000100:00100000:1.0:1788636867.854795:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226068992 00000100:00100000:1.0:1788636867.854851:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636867.854858:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+6:17183:x1875521226068992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636867.854942:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+6:17183:x1875521226068992:12345-0@lo:501:mount.lustre.0 Request processed in 84us (240us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788636867.854949:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788636867.855456:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226068992:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788636867.855490:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788636867.855603:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636867.855612:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636867.855621:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cef03105000 10000000:01000000:2.0:1788636867.855627:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788636867.855632:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cef03105000 10000000:01000000:2.0:1788636867.855634:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788636867.855637:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cef03105000 from 1 10000000:01000000:2.0:1788636867.855640:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788636867.855664:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e83932d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636867.855672:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e83932d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636867.855680:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e83932d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636867.855694:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226069120:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636867.855735:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636867.855773:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008ab7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636867.855897:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226069120 00000100:00100000:3.0:1788636867.855903:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226069120 00000100:00100000:3.0:1788636867.855938:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788636867.855946:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+6:17183:x1875521226069120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636867.855957:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636867.855976:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0061f8c00/0x5b741ef42e839334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83932d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636867.855994:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0061f8c00/0x5b741ef42e839334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83932d expref: 7 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636867.856127:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0061f8c00/0x5b741ef42e839334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83932d expref: 7 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636867.856136:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8c00, rc 0) 00000100:00100000:3.0:1788636867.856176:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+7:17183:x1875521226069120:12345-0@lo:101:mount.lustre.0 Request processed in 231us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636867.856183:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636867.856270:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226069120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636867.856280:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e83932d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839334 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636867.856288:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e83932d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839334 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636867.856299:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788636867.858885:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e83932d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839334 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636867.858901:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0a00/0x5b741ef42e83932d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839334 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636867.858911:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788636867.858920:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788636867.858927:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cef03105000 10000000:01000000:2.0:1788636867.858930:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788636867.858934:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788636867.858937:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788636867.858972:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1600/0x5b741ef42e83933b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636867.858980:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1600/0x5b741ef42e83933b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636867.858990:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1600/0x5b741ef42e83933b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636867.859044:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226069248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636867.859113:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636867.859195:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226069248 00000100:00100000:3.0:1788636867.859203:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226069248 00000100:00100000:3.0:1788636867.859254:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788636867.859263:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+7:17183:x1875521226069248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636867.859274:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636867.859286:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0061f8e00/0x5b741ef42e839342 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83933b expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636867.859308:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0061f8e00/0x5b741ef42e839342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83933b expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636867.859319:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0061f8e00/0x5b741ef42e839342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83933b expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636867.859328:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8e00, rc 0) 00000100:00100000:3.0:1788636867.859361:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+8:17183:x1875521226069248:12345-0@lo:101:mount.lustre.0 Request processed in 98us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636867.859387:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636867.861593:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008ab7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636867.861636:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226069248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636867.861662:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1600/0x5b741ef42e83933b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839342 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636867.861675:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1600/0x5b741ef42e83933b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839342 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636867.861763:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226069376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636867.862101:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636867.862184:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008ab7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636867.862237:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226069376 00000100:00100000:3.0:1788636867.862243:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226069376 00000100:00100000:3.0:1788636867.862328:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636867.862340:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+8:17183:x1875521226069376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636867.862520:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+9:17183:x1875521226069376:12345-0@lo:501:mount.lustre.0 Request processed in 182us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636867.862529:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636867.862604:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226069376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636867.862661:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226069504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636867.862700:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636867.862896:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008ab7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636867.863009:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226069504 00000100:00100000:1.0:1788636867.863014:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226069504 00000100:00100000:1.0:1788636867.863042:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636867.863048:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+9:17183:x1875521226069504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636867.864290:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+9:17183:x1875521226069504:12345-0@lo:503:mount.lustre.0 Request processed in 1236us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636867.864302:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636867.865292:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226069504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788636867.867419:0:17222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17222:1875521226069632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636867.867737:0:17222:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636867.867891:0:17222:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0061fc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636867.868164:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226069632 00000100:00100000:3.0:1788636867.868173:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226069632 00000100:00100000:3.0:1788636867.868262:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636867.868272:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+9:17222:x1875521226069632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636867.869085:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+9:17222:x1875521226069632:12345-0@lo:502:llog_process_th.0 Request processed in 810us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636867.869095:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636867.869274:0:17222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17222:1875521226069632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636867.869306:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636867.869317:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636867.869320:0:17222:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788636867.869325:0:17222:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788636867.869327:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636867.869343:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9cf040bc0000) 00000020:00000080:0.0:1788636867.869358:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788636867.869364:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788636867.869468:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788636867.869475:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e839350 00000020:00000080:0.0:1788636867.869749:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788636867.869753:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636867.869757:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636867.869759:0:17222:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788636867.869762:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636867.869765:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636867.869766:0:17222:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788636867.869770:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636867.869777:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9cf040bc3380) 00000020:00000080:0.0:1788636867.869788:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788636867.869792:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788636867.869794:0:17222:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788636867.869797:0:17222:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788636867.869802:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788636867.870134:0:17222:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cef03105000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788636867.870149:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9cef02724d40) 00000020:00000080:1.0:1788636867.870157:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788636867.870224:0:17222:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788636867.870230:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e839365 00000020:00000080:1.0:1788636867.870331:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788636867.870337:0:17222:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788636867.870341:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5b741ef42e83936c 00080000:01000000:1.0:1788636867.870347:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788636867.870350:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e839373 00010000:00010000:2.0:1788636867.951166:0:17222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788636867.951666:0:17222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788636867.952113:0:17222:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788636867.952639:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9cef0323cd40) 00000020:00000080:2.0:1788636867.952658:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788636867.952739:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788636867.952750:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e839381 00000020:00000080:2.0:1788636867.953342:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788636867.959165:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5b741ef42e839388 00000020:00000080:2.0:1788636867.963550:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788636867.963566:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636867.963577:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636867.963580:0:17222:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788636867.963584:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788636867.963587:0:17222:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788636867.963588:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788636867.963590:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788636867.963591:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788636867.963594:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636867.963595:0:17222:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788636867.963597:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636867.963603:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636867.963604:0:17222:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788636867.963609:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788636867.963664:0:17222:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788636867.963681:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636867.963685:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636867.963686:0:17222:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788636867.963689:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636867.963692:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636867.963694:0:17222:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788636867.963696:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788636867.963701:0:17222:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:00000080:2.0:1788636867.963731:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788636867.963747:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9cef032399c0) 00000020:00000080:2.0:1788636867.963778:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788636867.963784:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788636867.963864:0:17222:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788636867.963870:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788636867.963890:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e839396 00010000:00080000:2.0:1788636867.963922:0:17222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf002f65000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.126@tcp at head 00010000:00010000:2.0:1788636867.974206:0:17222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788636867.978145:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636867.978159:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788636867.978199:0:17222:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788636867.978215:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e83939d 00000100:00080000:3.0:1788636867.978225:0:17222:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636867.978232:0:17222:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cf002f65000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636867.978266:0:17222:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcac700 x1875521226069760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636867.978293:0:17222:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788636867.978367:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226069760:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788636867.978446:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636867.980010:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226069760 00000100:00100000:3.0:1788636867.980023:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226069760 00000100:00100000:3.0:1788636867.980064:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636867.980071:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875521226069760:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788636867.980092:0:17209:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:2.0:1788636867.992987:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636867.992997:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636867.993000:0:17222:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788636867.993004:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788636867.993008:0:17222:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788636867.993009:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788636867.993011:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788636867.993012:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788636867.993015:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636867.993017:0:17222:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788636867.993019:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788636867.993024:0:17222:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788636867.993027:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636867.993029:0:17222:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788636867.993032:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788636867.993036:0:17222:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:01000000:2.0:1788636867.993065:0:17222:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788636867.993069:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788636867.993089:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cef03238000) 00000020:00000080:2.0:1788636867.993110:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788636867.993116:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788636867.993220:0:17222:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788636867.993227:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788636867.993237:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e8393ab 00010000:00080000:2.0:1788636867.993272:0:17222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf015a7a000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.126@tcp at head 00010000:00010000:2.0:1788636867.993513:0:17222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788636867.995632:0:17222:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788636867.996217:0:17222:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788636868.005038:0:17222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636868.008535:0:17222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788636868.022052:0:17222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788636868.023704:0:17228:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788636868.023710:0:17228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788636868.025654:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788636868.025673:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788636868.025721:0:17222:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788636868.025745:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e8393b2 00000100:00080000:1.0:1788636868.025757:0:17222:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636868.025763:0:17222:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf015a7a000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636868.025985:0:17222:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf012918700 x1875521226069888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636868.026012:0:17222:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788636868.026064:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636868.026080:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636868.026082:0:17222:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788636868.026086:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788636868.026089:0:17222:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788636868.026090:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636868.026092:0:17222:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636868.026093:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788636868.026095:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636868.026097:0:17222:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788636868.026099:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788636868.026103:0:17222:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788636868.026107:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636868.026108:0:17222:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788636868.026111:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788636868.026114:0:17222:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:01000000:1.0:1788636868.026140:0:17222:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788636868.026143:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636868.026157:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cef027219c0) 00000020:00000080:1.0:1788636868.026170:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788636868.026174:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788636868.026251:0:17222:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788636868.026257:0:17222:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788636868.026264:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5b741ef42e8393c0 00010000:00080000:1.0:1788636868.026292:0:17222:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf032424800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.126@tcp at head 00000100:00100000:0.0:1788636868.026595:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226069888:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788636868.026648:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875521226069888 offset 0 length 520: 4 00010000:00010000:1.0:1788636868.027268:0:17222:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788636868.027699:0:17222:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788636868.027717:0:17222:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788636868.028618:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875521226069760:12345-0@lo:38:llog_process_th.0 Request processed in 48540us (50165us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788636868.028635:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788636868.029649:0:17222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636868.029952:0:17222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788636868.030097:0:17222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788636868.031733:0:17230:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788636868.031739:0:17230:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788636868.032833:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788636868.032847:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788636868.032892:0:17222:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788636868.032915:0:17222:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e8393c7 00000100:00080000:1.0:1788636868.032927:0:17222:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636868.032933:0:17222:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf032424800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636868.032968:0:17222:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf01291b480 x1875521226070016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636868.032985:0:17222:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788636868.033034:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636868.033038:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636868.033040:0:17222:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788636868.033042:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636868.033046:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636868.033048:0:17222:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788636868.033051:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788636868.033053:0:17222:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788636868.033055:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636868.033057:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636868.033058:0:17222:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788636868.033060:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636868.033063:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636868.033064:0:17222:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788636868.033068:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788636868.033095:0:17222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012919f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17222:1875521226070144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636868.033169:0:17222:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636868.033206:0:17222:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf016980f00 going to sleep for 11 seconds 00000100:00080000:0.0:1788636868.033756:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636868.033762:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788636868.033766:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226069760:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788636868.033845:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226070144 00000100:00100000:0.0:1788636868.033852:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226070144 00000100:00100000:0.0:1788636868.033902:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636868.033912:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+9:17222:x1875521226070144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636868.034045:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+9:17222:x1875521226070144:12345-0@lo:502:llog_process_th.0 Request processed in 134us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636868.034053:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636868.034405:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226070016:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788636868.034434:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875521226070016 offset 0 length 520: 4 00000100:00100000:1.0:1788636868.034490:0:17222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012919f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17222:1875521226070144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636868.034518:0:17222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636868.034528:0:17222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636868.034531:0:17222:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788636868.034535:0:17222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788636868.034746:0:17183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788636868.034780:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788636868.034827:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1600/0x5b741ef42e83933b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839342 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.034839:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1600/0x5b741ef42e83933b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839342 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636868.034848:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cef03105000 from 1 10000000:01000000:2.0:1788636868.034852:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788636868.034879:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.034888:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.034897:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636868.034911:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226070272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636868.034941:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636868.034969:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0081fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636868.035033:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226070272 00000100:00100000:3.0:1788636868.035041:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226070272 00000100:00100000:3.0:1788636868.035077:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636868.035085:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+9:17183:x1875521226070272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636868.035096:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636868.035110:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0061f8400/0x5b741ef42e8393d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8393ce expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.035133:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0061f8400/0x5b741ef42e8393d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8393ce expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.035144:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0061f8400/0x5b741ef42e8393d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8393ce expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.035151:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8400, rc 0) 00000100:00100000:3.0:1788636868.035193:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+10:17183:x1875521226070272:12345-0@lo:101:mount.lustre.0 Request processed in 110us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636868.035199:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636868.035388:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226070272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636868.035402:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.035422:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636868.036122:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226070400:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788636868.036166:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636868.036193:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0081fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636868.036272:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226070400 00000100:00100000:3.0:1788636868.036277:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226070400 00000100:00100000:3.0:1788636868.036314:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788636868.036322:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+10:17183:x1875521226070400:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788636868.036338:0:17199:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788636868.036344:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788636868.036420:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+10:17183:x1875521226070400:12345-0@lo:256:mount.lustre.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636868.036434:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636868.036777:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226070400:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788636868.038460:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788636868.038584:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.038597:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636868.038605:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cef03105000 from 1 10000000:01000000:2.0:1788636868.038607:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636868.038646:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.038654:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.038664:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636868.038682:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226070528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636868.038738:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636868.039177:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0081fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636868.044006:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226070528 00000100:00100000:3.0:1788636868.044021:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226070528 00000100:00100000:0.0:1788636868.044151:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788636868.044162:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+10:17183:x1875521226070528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636868.044178:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636868.044202:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8393e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8393dc expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636868.044229:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8393e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8393dc expref: 11 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636868.044241:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8393e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8393dc expref: 11 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636868.044250:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6a00, rc 0) 00000100:00100000:0.0:1788636868.044324:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+11:17183:x1875521226070528:12345-0@lo:101:mount.lustre.0 Request processed in 163us (5584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636868.044343:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636868.044491:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226070528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636868.044510:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.044519:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636868.044592:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226070656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636868.044625:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636868.044662:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0081fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636868.044788:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226070656 00000100:00100000:3.0:1788636868.044793:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226070656 00000100:00100000:3.0:1788636868.044857:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636868.044864:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+11:17183:x1875521226070656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636868.044992:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+11:17183:x1875521226070656:12345-0@lo:501:mount.lustre.0 Request processed in 127us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636868.044999:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636868.045201:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226070656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636868.045228:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226070784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636868.045270:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636868.045333:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0081fb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636868.050009:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226070784 00000100:00100000:1.0:1788636868.050025:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226070784 00000100:00100000:1.0:1788636868.050087:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788636868.050098:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+11:17183:x1875521226070784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636868.050274:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+11:17183:x1875521226070784:12345-0@lo:503:mount.lustre.0 Request processed in 177us (5003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636868.050282:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636868.050509:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226070784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636868.053060:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17232:1875521226070912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636868.053148:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636868.053198:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aac23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636868.053254:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226070912 00000100:00100000:1.0:1788636868.053261:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226070912 00000100:00100000:1.0:1788636868.053308:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788636868.053318:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+11:17232:x1875521226070912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636868.054740:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+11:17232:x1875521226070912:12345-0@lo:502:llog_process_th.0 Request processed in 1416us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636868.054752:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636868.054995:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17232:1875521226070912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788636868.055029:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636868.055039:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636868.055041:0:17232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788636868.055047:0:17232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cef03105000 00000020:00000080:3.0:1788636868.055050:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636868.055057:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636868.055059:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636868.055061:0:17232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788636868.055064:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636868.055066:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636868.055067:0:17232:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788636868.055070:0:17232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cef03105000 00000020:00000080:3.0:1788636868.055073:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636868.055133:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636868.055145:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636868.055146:0:17232:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788636868.055149:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636868.055151:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636868.055152:0:17232:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788636868.055156:0:17232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cef03105000 00000020:00000080:3.0:1788636868.055158:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636868.055179:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636868.055182:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636868.055183:0:17232:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788636868.055186:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636868.055188:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636868.055189:0:17232:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788636868.055192:0:17232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cef03105000 00000020:00000080:3.0:1788636868.055194:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788636868.055234:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17232:1875521226071040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636868.055281:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636868.055322:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aac23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636868.055835:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226071040 00000100:00100000:2.0:1788636868.055843:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226071040 00000100:00100000:2.0:1788636868.055897:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636868.055908:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+11:17232:x1875521226071040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636868.056038:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+11:17232:x1875521226071040:12345-0@lo:502:llog_process_th.0 Request processed in 132us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636868.056045:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636868.056197:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17232:1875521226071040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636868.056225:0:17232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636868.056231:0:17232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636868.056233:0:17232:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788636868.056237:0:17232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788636868.059385:0:17183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788636868.059429:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636868.059452:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.059474:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636868.059546:0:17183:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788636868.059549:0:17183:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cef03105000 10000000:01000000:2.0:1788636868.059552:0:17183:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cef03105000 10000000:01000000:2.0:1788636868.059556:0:17183:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788636868.059563:0:17183:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cef03105000 from 1 10000000:01000000:2.0:1788636868.059565:0:17183:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788636868.059605:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0800/0x5b741ef42e8393ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.059614:0:17183:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0800/0x5b741ef42e8393ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.059625:0:17183:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0800/0x5b741ef42e8393ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636868.059648:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226071168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636868.059713:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636868.059775:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0081fb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788636868.061552:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226071168 00000100:00100000:0.0:1788636868.061588:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226071168 00000100:00100000:0.0:1788636868.061659:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636868.061671:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+11:17183:x1875521226071168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636868.061694:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636868.061720:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e8393f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8393ea expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636868.061771:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e8393f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8393ea expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636868.061784:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7600/0x5b741ef42e8393f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8393ea expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636868.061792:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7600, rc 0) 00000100:00100000:0.0:1788636868.061904:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+12:17183:x1875521226071168:12345-0@lo:101:mount.lustre.0 Request processed in 236us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636868.061910:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788636868.064110:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226071168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636868.064157:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0800/0x5b741ef42e8393ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8393f1 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.064168:0:17183:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0800/0x5b741ef42e8393ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8393f1 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636868.064266:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226071296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636868.064324:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636868.064369:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aac2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636868.065441:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226071296 00000100:00100000:0.0:1788636868.065452:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226071296 00000100:00100000:0.0:1788636868.065517:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636868.065527:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17183:x1875521226071296:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636868.065715:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17183:x1875521226071296:12345-0@lo:501:mount.lustre.0 Request processed in 189us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636868.065723:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788636868.083566:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226071296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636868.083649:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226071424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636868.083723:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636868.083767:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aac2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788636868.086894:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226071424 00000100:00100000:2.0:1788636868.086909:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226071424 00000100:00100000:2.0:1788636868.086972:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788636868.086983:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+12:17183:x1875521226071424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636868.087150:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+12:17183:x1875521226071424:12345-0@lo:503:mount.lustre.0 Request processed in 167us (3426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636868.087157:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788636868.092883:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226071424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636868.109950:0:17237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012919f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17237:1875521226071552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636868.110039:0:17237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636868.110085:0:17237:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0169806c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636868.110297:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226071552 00000100:00100000:0.0:1788636868.110305:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226071552 00000100:00100000:0.0:1788636868.110352:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636868.110362:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+12:17237:x1875521226071552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636868.111288:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+12:17237:x1875521226071552:12345-0@lo:502:llog_process_th.0 Request processed in 922us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636868.111298:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788636868.111594:0:17237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012919f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17237:1875521226071552:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788636868.111662:0:17237:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788636868.111678:0:17237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9cef02720000) 00000020:00000080:1.0:1788636868.111698:0:17237:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788636868.116424:0:17237:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cef03105000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788636868.116433:0:17237:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cef03105000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788636868.116436:0:17237:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cef03105000 4 00010000:00080000:1.0:1788636868.116482:0:17237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf03fc60800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.126@tcp at head 00010000:00010000:1.0:1788636868.118032:0:17237:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788636868.120967:0:17237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788636868.121021:0:17237:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788636868.121036:0:17237:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5b741ef42e8393ff 00000100:00080000:0.0:1788636868.121048:0:17237:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788636868.121055:0:17237:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cf03fc60800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636868.121094:0:17237:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0237ce00 x1875521226071680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636868.121128:0:17237:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788636868.127948:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875521226071680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788636868.128022:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636868.132401:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226071680 00000100:00100000:1.0:1788636868.132420:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226071680 00000100:00100000:1.0:1788636868.134226:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636868.134246:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521226071680:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788636868.134356:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521226071680:12345-0@lo:38:llog_process_th.0 Request processed in 112us (6332us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788636868.134364:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636868.136772:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636868.136787:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc60800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636868.136794:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788636868.136798:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875521226071680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788636868.144163:0:17237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17237:1875521226071808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636868.144242:0:17237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636868.144286:0:17237:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0081fbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636868.144590:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226071808 00000100:00100000:0.0:1788636868.144599:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226071808 00000100:00100000:0.0:1788636868.144649:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788636868.144660:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17237:x1875521226071808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636868.144787:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17237:x1875521226071808:12345-0@lo:502:llog_process_th.0 Request processed in 128us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636868.144795:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788636868.144940:0:17237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17237:1875521226071808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636868.144991:0:17237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17237:1875521226071936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636868.145027:0:17237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636868.145049:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226071936 00000100:00100000:0.0:1788636868.145054:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226071936 00000100:00100000:0.0:1788636868.145078:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636868.145083:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17237:x1875521226071936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636868.146507:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17237:x1875521226071936:12345-0@lo:502:llog_process_th.0 Request processed in 1416us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636868.146520:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636868.146574:0:17237:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf005ae5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636868.146595:0:17237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c7a34533-966f-4857-8403-9471b802ebf2:17237:1875521226071936:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788636868.146626:0:17237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788636868.147212:0:17183:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788636868.147247:0:17183:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788636868.147268:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0800/0x5b741ef42e8393ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8393f1 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636868.147280:0:17183:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0800/0x5b741ef42e8393ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8393f1 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788636868.147331:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788636868.147333:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788636868.147335:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636868.147336:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636868.147337:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636868.147338:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636868.147340:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636868.147342:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788636868.147343:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636868.147344:0:17183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636868.147348:0:17183:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788636868.147350:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788636868.147352:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788636868.147353:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636868.147354:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636868.147355:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636868.147356:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636868.147358:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636868.147359:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788636868.147364:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636868.147364:0:17183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636868.147395:0:17183:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788636868.147411:0:17183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226072064:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788636868.147461:0:17183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636868.147491:0:17183:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0081fbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636868.147509:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226072064 00000100:00100000:2.0:1788636868.147515:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226072064 00000100:00100000:2.0:1788636868.147549:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788636868.147556:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+12:17183:x1875521226072064:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788636868.147580:0:17198:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788636868.147592:0:17198:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788636868.167013:0:17198:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788636868.167077:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788636868.170553:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+12:17183:x1875521226072064:12345-0@lo:253:mount.lustre.0 Request processed in 22988us (23082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636868.170568:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788636868.170632:0:17183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17183:1875521226072064:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788636868.170648:0:17183:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788636868.170651:0:17183:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636868.170653:0:17183:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788636868.170654:0:17183:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636868.170656:0:17183:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636868.170657:0:17183:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636868.170658:0:17183:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636868.170660:0:17183:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636868.170661:0:17183:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788636868.170663:0:17183:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636868.170664:0:17183:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788636868.170680:0:17183:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788636868.175978:0:17220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788636868.175988:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788636868.176013:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.176033:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0061f8400/0x5b741ef42e8393d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8393ce expref: 11 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.176043:0:17220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.176090:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0061f8400/0x5b741ef42e8393d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8393ce expref: 11 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.176108:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0061f8400/0x5b741ef42e8393d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8393ce expref: 11 pid: 17196 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636868.176149:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012919f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226072192:0@lo:104: 00000100:00100000:1.0:1788636868.176212:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636868.176261:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aa2d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788636868.176430:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226072192 00000100:00100000:3.0:1788636868.176438:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226072192 00000100:00100000:3.0:1788636868.176499:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636868.176509:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:17220:x1875521226072192:12345-0@lo:104: 00010000:00010000:3.0:1788636868.176522:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.176575:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636868.176581:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:17220:x1875521226072192:12345-0@lo:104: Request processed in 74us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636868.176588:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788636868.176620:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636868.176627:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.176634:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636868.176637:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.176645:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636868.176652:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636868.176658:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636868.176695:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.176701:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636868.176719:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.176726:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8393ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8393d5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.176745:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636868.176747:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636868.176749:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636868.176791:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226072320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636868.176854:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636868.176936:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012919f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226072192:0@lo:104: 00010000:00010000:3.0:1788636868.176956:0:17220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636868.177583:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226072320 00000100:00100000:1.0:1788636868.177590:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226072320 00010000:00010000:1.0:1788636868.177613:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0061f8400/0x5b741ef42e8393d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8393ce expref: 12 pid: 17196 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636868.177647:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636868.177655:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+12:3646:x1875521226072320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636868.177665:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636868.177669:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0061f8400/0x5b741ef42e8393d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8393ce expref: 12 pid: 17196 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177680:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0061f8400/0x5b741ef42e8393d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8393ce expref: 12 pid: 17196 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177693:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0061f8400/0x5b741ef42e8393d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8393ce expref: 12 pid: 17196 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177707:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177715:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788636868.177729:0:17189:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001741103s 00010000:00010000:1.0:1788636868.177733:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177763:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177770:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177776:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177782:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636868.177786:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177793:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177900:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636868.177910:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636868.177955:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+11:3646:x1875521226072320:12345-0@lo:103:ldlm_bl.0 Request processed in 301us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636868.177962:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636868.178246:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226072320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636868.178270:0:17220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.178278:0:17220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636868.178285:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab36a00/0x5b741ef42e839406 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788636868.211023:0:17183:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788636868.211674:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788636868.211757:0:17244:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788636868.211768:0:17244:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788636868.212711:0:17245:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788636868.213296:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788636868.214093:0:17245:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788636868.216881:0:17246:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9cef033bdf80 x1875521226072448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636868.216899:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00000040:01000000:0.0:1788636868.217517:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788636868.217578:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788636868.218085:0:17183:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788636868.218093:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788636868.218130:0:17183:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636868.219161:0:17183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788636868.219692:0:17183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788636868.219731:0:17183:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788636868.224276:0:17245:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788636868.224364:0:17245:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:0.0:1788636868.232021:0:17183:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788636868.237052:0:17183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788636868.245039:0:17183:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788636868.245086:0:17183:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb25401c73988 00100000:10000000:2.0:1788636868.245094:0:17183:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788636868.246704:0:17183:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788636868.246720:0:17183:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788636868.246740:0:17183:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788636868.246755:0:17183:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788636868.251730:0:17183:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636868.251994:0:17183:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788636868.694320:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788636869.013856:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788636869.013862:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cef03105000 from 7 10000000:01000000:3.0:1788636869.013867:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788636869.013910:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636869.013924:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636869.013936:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636869.013976:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226072576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636869.014052:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636869.014101:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636869.014237:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226072576 00000100:00100000:0.0:1788636869.014245:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226072576 00000100:00100000:0.0:1788636869.014308:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788636869.014319:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+11:17201:x1875521226072576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636869.014341:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636869.014356:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83940d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636869.014393:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83940d expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636869.014406:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83940d expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636869.014416:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7200, rc 0) 00000100:00100000:0.0:1788636869.014468:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+12:17201:x1875521226072576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636869.014475:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788636869.014700:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226072576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636869.014717:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636869.014727:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636869.014778:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226072704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788636869.014836:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636869.014855:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef024ad180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636869.014921:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226072704 00000100:00100000:2.0:1788636869.014926:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226072704 00000100:00100000:2.0:1788636869.015034:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636869.015042:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17201:x1875521226072704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788636869.015059:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788636869.015076:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788636869.015080:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788636869.015157:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17201:x1875521226072704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636869.015164:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788636869.015261:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226072704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788636869.015299:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788636869.015306:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636869.015319:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636869.141483:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788636869.270901:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:3.0:1788636869.717044:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788636870.168077:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788636870.296437:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:1.0:1788636870.741048:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636871.320000:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:3.0:1788636871.766165:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636872.340888:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:3.0:1788636872.791337:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636873.377557:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00000100:00080000:1.0:1788636873.384282:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788636873.384289:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788636873.384293:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636873.384302:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 536 00000100:00080000:1.0:1788636873.384308:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788636873.384315:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cf002f65000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636873.384337:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf012919c00 x1875521226072960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636873.384352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636873.384356:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788636873.384358:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636873.384361:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788636873.384364:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788636873.384366:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788636873.384368:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc60800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636873.384372:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cf03fc60800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636873.384383:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf012918000 x1875521226073088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636873.384438:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636873.384455:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226072832:0@lo:400:kworker.0 00000100:00100000:0.0:1788636873.384521:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636873.384584:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226072960:0@lo:38:kworker.0 00000100:00100000:0.0:1788636873.384610:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636873.384633:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875521226073088:0@lo:38:kworker.0 00000100:00100000:0.0:1788636873.384657:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636873.384704:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226072960 00000100:00100000:0.0:1788636873.384711:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226072960 00000100:00100000:0.0:1788636873.384738:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636873.384745:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875521226072960:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788636873.384762:0:17210:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788636873.385519:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226072832 00000100:00100000:1.0:1788636873.385527:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226072832 00000100:00100000:1.0:1788636873.385570:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788636873.385579:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:3646:x1875521226072832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636873.385650:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:3646:x1875521226072832:12345-0@lo:400:kworker.0 Request processed in 73us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636873.385657:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788636873.387562:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226073088 00000100:00100000:2.0:1788636873.387577:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226073088 00000100:00100000:2.0:1788636873.387624:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636873.387632:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875521226073088:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788636873.387657:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1788636873.388451:0:17206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5b741ef42e83941b 00000004:00100000:2.0:1788636873.388476:0:17206:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788636873.388611:0:17206:0:(import.c:65:import_set_state_nolock()) ffff9cf0321a6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636873.390297:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875521226073088:12345-0@lo:38:kworker.0 Request processed in 2658us (5632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636873.390310:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788636873.398563:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf012918000 x1875521226073088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788636873.398589:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788636873.398599:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788636873.398606:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788636873.398609:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf03fc60800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788636873.398617:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875521226073088:0@lo:38:kworker.0 00000100:00100000:1.0:1788636873.400077:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226072832:0@lo:400:kworker.0 00000100:00100000:0.0:1788636873.404275:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875521226072960:12345-0@lo:38:kworker.0 Request processed in 19523us (19657us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788636873.404293:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788636873.404345:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636873.404350:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788636873.404355:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226072960:0@lo:38:kworker.0 00000001:02000400:3.0:1788636873.476626:0:17488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788636873.822756:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636874.400155:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00000020:00000004:3.0:1788636874.590122:0:17541:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636874.590303:0:17541:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788636874.837339:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636875.437962:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00000020:00000004:2.0:1788636875.635439:0:17591:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788636875.635778:0:17591:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788636875.874786:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636876.502049:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:3.0:1788636876.890251:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636877.525932:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:0.0:1788636877.910422:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788636878.484963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788636878.484972:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788636878.484977:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636878.484989:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:1.0:1788636878.484996:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788636878.485008:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cf002f65000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636878.485033:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226073216:0@lo:400:kworker.0 00000100:00100000:1.0:1788636878.485035:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf012918000 x1875521226073344/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636878.485060:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636878.485064:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788636878.485067:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636878.485084:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788636878.485119:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636868/real 1788636868] req@ffff9cf01291b480 x1875521226070016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636878 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636878.485143:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf01291b480 x1875521226070016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636878 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636878.485216:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226073472:0@lo:400:kworker.0 00000100:00100000:0.0:1788636878.485504:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636878.485603:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636878.485668:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226073472 00000100:00100000:0.0:1788636878.485679:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226073472 00000100:00100000:2.0:1788636878.485694:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226073216 00000100:00100000:2.0:1788636878.485705:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226073216 00000100:00100000:0.0:1788636878.485737:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636878.485751:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226073472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636878.486000:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788636878.486016:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+12:3648:x1875521226073216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636878.486056:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226073472:12345-0@lo:400:kworker.0 Request processed in 306us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636878.486066:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788636878.486138:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf012918a80 x1875521226073472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636878.486154:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226073472:0@lo:400:kworker.0 00000100:00100000:1.0:1788636878.486614:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636868/real 1788636868] req@ffff9cf012918700 x1875521226069888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636878 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636878.486634:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf012918700 x1875521226069888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636878 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636878.486653:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226073344:0@lo:38:kworker.0 00000100:00100000:2.0:1788636878.486734:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+12:3648:x1875521226073216:12345-0@lo:400:kworker.0 Request processed in 715us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636878.486746:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788636878.486754:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788636878.486790:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636878.486830:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788636878.486835:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226070016:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788636878.486840:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf015a7a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636878.486845:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788636878.486847:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226069888:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788636878.486885:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226073344 00000100:00080000:1.0:1788636878.486892:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788636878.486892:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226073344 00000100:00080000:1.0:1788636878.486899:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788636878.486902:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf015a7a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636878.486906:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 536 00000100:00080000:1.0:1788636878.486911:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788636878.486916:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf015a7a000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636878.486925:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636878.486934:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875521226073344:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788636878.486957:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf012918700 x1875521226073600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636878.486974:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636878.486977:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788636878.486979:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636878.486982:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 536 00000100:00080000:1.0:1788636878.486984:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788636878.486987:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf032424800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636878.486995:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf01291b480 x1875521226073728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636878.487014:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226073600:0@lo:8:kworker.0 00000400:00000100:1.0:1788636878.487034:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875521226073600 offset 0 length 520: 4 00000100:00100000:1.0:1788636878.487052:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226073728:0@lo:8:kworker.0 00000400:00000100:1.0:1788636878.487063:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875521226073728 offset 0 length 520: 4 00000100:00100000:2.0:1788636878.487298:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226073216:0@lo:400:kworker.0 00010000:00020000:0.0:1788636878.487506:0:17209:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788636878.501668:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875521226073344:12345-0@lo:38:kworker.0 Request processed in 14724us (14904us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788636878.501706:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788636878.501880:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636878.501887:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788636878.501892:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226073344:0@lo:38:kworker.0 00000100:00100000:1.0:1788636878.549426:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:3.0:1788636878.937923:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636879.586544:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:0.0:1788636879.958731:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788636880.413263:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788636880.596947:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:1.0:1788636880.983045:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636881.622688:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:1.0:1788636882.008763:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636882.646740:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:0.0:1788636883.029691:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788636883.607468:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788636883.607475:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788636883.607479:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636883.607488:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:3.0:1788636883.607494:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788636883.607500:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cf002f65000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636883.607520:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcadc00 x1875521226073984/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636883.607535:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636883.607538:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636883.607541:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636883.607557:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788636883.607639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226074112:0@lo:400:kworker.0 00000100:00100000:0.0:1788636883.607701:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636883.607768:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636883.607774:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226073856:0@lo:400:kworker.0 00000100:00100000:0.0:1788636883.607802:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636883.607911:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226073984:0@lo:38:kworker.0 00000100:00100000:1.0:1788636883.607942:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636883.612441:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226073984 00000100:00100000:0.0:1788636883.612457:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226073984 00000100:00100000:0.0:1788636883.612506:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636883.612514:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875521226073984:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788636883.612538:0:17210:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788636883.612706:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226074112 00000100:00100000:3.0:1788636883.612711:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226074112 00000100:00100000:3.0:1788636883.612760:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636883.612767:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226074112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636883.612886:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226074112:12345-0@lo:400:kworker.0 Request processed in 119us (5184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636883.612894:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788636883.612942:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf03fcaf480 x1875521226074112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636883.612958:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226074112:0@lo:400:kworker.0 00000100:00100000:3.0:1788636883.613004:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226073856 00000100:00100000:3.0:1788636883.613008:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226073856 00000100:00100000:3.0:1788636883.613034:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636883.613041:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+12:3647:x1875521226073856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636883.613077:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+12:3647:x1875521226073856:12345-0@lo:400:kworker.0 Request processed in 36us (5274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636883.613083:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636883.613120:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226073856:0@lo:400:kworker.0 00000100:00100000:1.0:1788636883.625167:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875521226073984:12345-0@lo:38:kworker.0 Request processed in 12645us (17216us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788636883.625197:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788636883.625407:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636883.625413:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788636883.625417:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226073984:0@lo:38:kworker.0 00000100:00100000:1.0:1788636883.677879:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00000020:01000004:1.0:1788636884.049502:0:17936:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788636884.049509:0:17936:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788636884.049511:0:17936:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788636884.049644:0:17936:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cf0113d7000 00000020:01000004:1.0:1788636884.049664:0:17936:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788636884.049676:0:17936:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788636884.049707:0:17936:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9cf0339d99c0) 00000020:00000080:1.0:1788636884.049724:0:17936:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788636884.057364:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788636884.180549:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788636884.181522:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788636884.192481:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788636884.194185:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788636884.196727:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788636884.197803:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788636884.198196:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788636884.200024:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788636884.200616:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788636884.200856:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.201232:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.201567:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.201768:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.202049:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.202306:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.202571:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.202925:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.203414:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.203878:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.204262:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.204520:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.205135:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.205483:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.205856:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.206221:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.206452:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.206784:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.207677:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.207975:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.208909:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788636884.210745:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.211833:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.212568:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.213286:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788636884.218981:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788636884.220491:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788636884.221900:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788636884.222251:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788636884.222532:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788636884.223157:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788636884.223749:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788636884.224441:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788636884.225131:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788636884.225549:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788636884.226431:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788636884.227378:0:17936:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1788636884.234102:0:17936:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788636884.234380:0:17936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788636884.234393:0:17936:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788636884.234406:0:17936:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e839429 00000020:01000004:2.0:1788636884.234413:0:17936:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788636884.234443:0:17936:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788636884.234447:0:17936:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788636884.234452:0:17936:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788636884.234481:0:17936:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788636884.234486:0:17936:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.126@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788636884.243759:0:17936:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.126@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788636884.243803:0:17936:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.126@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788636884.244008:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788636884.244010:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788636884.244012:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636884.244013:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636884.244014:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636884.244015:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636884.244017:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636884.244019:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636884.244021:0:17936:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788636884.244025:0:17936:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788636884.244028:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788636884.244029:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788636884.244030:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636884.244031:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636884.244032:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636884.244034:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636884.244034:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636884.244036:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636884.244037:0:17936:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788636884.244076:0:17936:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788636884.244097:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788636884.244174:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636884.244227:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aa2db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636884.244294:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226074240 00000100:00100000:1.0:1788636884.244302:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226074240 00000100:00100000:1.0:1788636884.244349:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788636884.244357:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17936:x1875521226074240:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788636884.244390:0:17196:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788636884.244393:0:17196:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788636884.244400:0:17196:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788636884.244985:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17936:x1875521226074240:12345-0@lo:253:mount.lustre.0 Request processed in 626us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636884.245001:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788636884.247022:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788636884.247041:0:17936:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788636884.247045:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636884.247047:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788636884.247048:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636884.247049:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636884.247051:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636884.247052:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636884.247053:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636884.247055:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636884.247056:0:17936:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788636884.247103:0:17936:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf0113d7000 from lustre-MDT0001 10000000:01000000:2.0:1788636884.247137:0:17936:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788636884.247140:0:17936:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788636884.247147:0:17936:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf040bc19c0 local copy 00010000:00010000:2.0:1788636884.247166:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636884.247265:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636884.247324:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636884.247365:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aa2db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636884.247850:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226074368 00000100:00100000:0.0:1788636884.247858:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226074368 00000100:00100000:0.0:1788636884.247907:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788636884.247918:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+12:17936:x1875521226074368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636884.248023:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+12:17936:x1875521226074368:12345-0@lo:501:mount.lustre.0 Request processed in 107us (698us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636884.248031:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788636884.248148:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074368:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788636884.248177:0:17936:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788636884.248200:0:17936:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788636884.248207:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.248217:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636884.248240:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf0113d7000 10000000:01000000:1.0:1788636884.248245:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788636884.248251:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cf040bc19c0 10000000:01000000:1.0:1788636884.248253:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788636884.248257:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cf040bc19c0 from 1 10000000:01000000:1.0:1788636884.248259:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788636884.248287:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36200/0x5b741ef42e839430 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.248295:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36200/0x5b741ef42e839430 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.248304:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36200/0x5b741ef42e839430 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636884.248319:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636884.248352:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.248385:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571240 going to sleep for 11 seconds 00000100:00100000:0.0:1788636884.248834:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226074496 00000100:00100000:0.0:1788636884.248839:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226074496 00000100:00100000:0.0:1788636884.248879:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788636884.248887:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+12:17936:x1875521226074496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636884.248898:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636884.248912:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e839437 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e839430 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.248934:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e839437 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e839430 expref: 13 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.248943:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7a00/0x5b741ef42e839437 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e839430 expref: 13 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.248952:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7a00, rc 0) 00000100:00100000:0.0:1788636884.248998:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+13:17936:x1875521226074496:12345-0@lo:101:mount.lustre.0 Request processed in 111us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636884.249004:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788636884.249313:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636884.249328:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36200/0x5b741ef42e839430 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839437 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.249337:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36200/0x5b741ef42e839430 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839437 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636884.249355:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788636884.249375:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36200/0x5b741ef42e839430 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839437 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.249383:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36200/0x5b741ef42e839430 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839437 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636884.249392:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cf0113d7000 10000000:01000000:1.0:1788636884.249396:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788636884.249400:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cf0113d7000 from 1 10000000:01000000:1.0:1788636884.249402:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788636884.249429:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37400/0x5b741ef42e83943e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.249437:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37400/0x5b741ef42e83943e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.249445:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37400/0x5b741ef42e83943e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636884.249460:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636884.249487:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.249515:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571240 going to sleep for 11 seconds 00000100:00100000:0.0:1788636884.249705:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226074624 00000100:00100000:0.0:1788636884.249711:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226074624 00000100:00100000:0.0:1788636884.249746:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788636884.249753:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+13:17936:x1875521226074624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636884.249762:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636884.249772:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7800/0x5b741ef42e839445 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83943e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.249787:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7800/0x5b741ef42e839445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83943e expref: 14 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.249796:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7800/0x5b741ef42e839445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83943e expref: 14 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.249801:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7800, rc 0) 00000100:00100000:0.0:1788636884.249869:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+14:17936:x1875521226074624:12345-0@lo:101:mount.lustre.0 Request processed in 116us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636884.249875:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788636884.250315:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636884.250328:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37400/0x5b741ef42e83943e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839445 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.250336:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37400/0x5b741ef42e83943e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839445 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636884.250349:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788636884.250366:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37400/0x5b741ef42e83943e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839445 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.250374:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37400/0x5b741ef42e83943e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839445 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636884.250381:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788636884.250385:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636884.250390:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cf0113d7000 10000000:01000000:1.0:1788636884.250393:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788636884.250396:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788636884.250399:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788636884.250416:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37200/0x5b741ef42e83944c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.250434:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37200/0x5b741ef42e83944c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.250442:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37200/0x5b741ef42e83944c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636884.250470:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636884.250501:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.250604:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571240 going to sleep for 11 seconds 00000100:00100000:2.0:1788636884.250732:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226074752 00000100:00100000:2.0:1788636884.250738:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226074752 00000100:00100000:2.0:1788636884.250780:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788636884.250789:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+14:17936:x1875521226074752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636884.250798:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636884.250830:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab0200/0x5b741ef42e839453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83944c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.250858:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab0200/0x5b741ef42e839453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83944c expref: 15 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.250867:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab0200/0x5b741ef42e839453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83944c expref: 15 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.250875:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0200, rc 0) 00000100:00100000:2.0:1788636884.250913:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+15:17936:x1875521226074752:12345-0@lo:101:mount.lustre.0 Request processed in 125us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636884.250920:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788636884.251295:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636884.251307:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37200/0x5b741ef42e83944c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839453 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.251316:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37200/0x5b741ef42e83944c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839453 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636884.256501:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1788636884.257695:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636884.264485:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788636884.264592:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788636884.264665:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788636884.264683:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788636884.264704:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788636884.264712:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788636884.264719:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788636884.264725:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788636884.264732:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788636884.264739:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788636884.264746:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788636884.264752:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788636884.264759:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788636884.264765:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788636884.264772:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788636884.264779:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788636884.264785:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788636884.264800:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788636884.265140:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788636884.265342:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788636884.265375:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788636884.265391:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788636884.265404:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788636884.265442:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788636884.265449:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788636884.266225:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636884.266288:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.266371:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636884.268297:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226074880 00000100:00100000:0.0:1788636884.268310:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226074880 00000100:00100000:0.0:1788636884.268411:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788636884.268431:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+15:17936:x1875521226074880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636884.268662:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+15:17936:x1875521226074880:12345-0@lo:501:mount.lustre.0 Request processed in 241us (2373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636884.268670:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788636884.268753:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226074880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636884.268826:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226075008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636884.268888:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.269492:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636884.269723:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226075008 00000100:00100000:2.0:1788636884.269739:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226075008 00000100:00100000:2.0:1788636884.269771:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636884.269779:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+15:17936:x1875521226075008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636884.271606:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+15:17936:x1875521226075008:12345-0@lo:503:mount.lustre.0 Request processed in 1810us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636884.271625:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788636884.279256:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226075008:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788636884.279833:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788636884.279926:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226075136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636884.280013:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.280047:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00b082a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788636884.281554:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226075136 00000100:00100000:0.0:1788636884.281568:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226075136 00000100:00100000:0.0:1788636884.281647:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788636884.281657:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+15:17936:x1875521226075136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788636884.284158:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+15:17936:x1875521226075136:12345-0@lo:502:mount.lustre.0 Request processed in 2493us (4135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636884.284276:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226075136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788636884.284535:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788636884.284567:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1788636884.284583:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000100:00100000:0.0:1788636884.284736:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000040:00080000:1.0:1788636884.285125:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1788636884.285153:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1788636884.285339:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1788636884.285368:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1788636884.285383:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1788636884.285397:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1788636884.285409:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1788636884.285452:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1788636884.285469:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1788636884.285482:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1788636884.285496:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1788636884.285509:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1788636884.285521:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1788636884.285533:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1788636884.285545:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1788636884.285559:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1788636884.285570:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1788636884.285583:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1788636884.285736:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1788636884.285757:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1788636884.285772:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1788636884.285784:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1788636884.285797:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1788636884.285975:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1788636884.286125:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1788636884.286135:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1788636884.286142:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1788636884.286149:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1788636884.286156:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788636884.294856:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788636884.294925:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788636884.294942:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788636884.294960:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788636884.294975:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788636884.295000:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788636884.295015:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788636884.295031:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788636884.295045:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788636884.295058:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788636884.295086:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788636884.295101:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788636884.295152:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226075264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788636884.295369:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636884.295415:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04097b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.295973:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226075264 00000100:00100000:3.0:1788636884.295990:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226075264 00000100:00100000:3.0:1788636884.296047:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788636884.296058:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+15:17936:x1875521226075264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636884.296237:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+15:17936:x1875521226075264:12345-0@lo:502:mount.lustre.0 Request processed in 179us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.296254:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788636884.296887:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226075264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788636884.296966:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1788636884.296978:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788636884.298443:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636884.298455:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636884.298458:0:17940:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788636884.298464:0:17940:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788636884.298467:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636884.298481:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9cf040bc4d40) 00000020:00000080:0.0:1788636884.298503:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788636884.298509:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788636884.298733:0:17940:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788636884.298742:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e839461 00000020:00000080:0.0:1788636884.299503:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788636884.299510:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636884.299515:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636884.299517:0:17940:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788636884.299520:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636884.299979:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636884.299982:0:17940:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788636884.299988:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636884.300303:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9cf03a60b380) 00000020:00000080:0.0:1788636884.300324:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788636884.300330:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788636884.300332:0:17940:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788636884.300334:0:17940:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788636884.300341:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788636884.300436:0:17940:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf0113d7000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788636884.300449:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9cf03a608000) 00000020:00000080:0.0:1788636884.300459:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788636884.300531:0:17940:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788636884.300539:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e839476 00000020:00000080:0.0:1788636884.300668:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788636884.300676:0:17940:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788636884.300680:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5b741ef42e83947d 00080000:01000000:0.0:1788636884.300688:0:17940:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788636884.300691:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e839484 00010000:00010000:0.0:1788636884.470971:0:17940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788636884.473360:0:17940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788636884.476050:0:17940:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788636884.481267:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788636884.481281:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636884.481288:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636884.481290:0:17940:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788636884.481294:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636884.481299:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636884.481300:0:17940:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788636884.481304:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788636884.481310:0:17940:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:00000080:3.0:1788636884.481339:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788636884.481354:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9cef034b19c0) 00000020:00000080:3.0:1788636884.481375:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788636884.481380:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788636884.481476:0:17940:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788636884.481483:0:17940:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788636884.481490:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e839492 00010000:00080000:3.0:1788636884.481532:0:17940:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf01135b800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.126@tcp at head 00010000:00010000:3.0:1788636884.492353:0:17940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788636884.499307:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788636884.499328:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788636884.499381:0:17940:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788636884.499410:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e839499 00000100:00080000:1.0:1788636884.499440:0:17940:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636884.499447:0:17940:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9cf01135b800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636884.499486:0:17940:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf012918e00 x1875521226075392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636884.499514:0:17940:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788636884.499569:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636884.499573:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.499575:0:17940:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788636884.499578:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788636884.499580:0:17940:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788636884.499582:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636884.499583:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636884.499585:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788636884.499587:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.499589:0:17940:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788636884.499591:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636884.499595:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.499597:0:17940:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788636884.499600:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788636884.499644:0:17940:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788636884.499657:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636884.499661:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.499662:0:17940:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788636884.499664:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788636884.499666:0:17940:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788636884.499667:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636884.499668:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636884.499669:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788636884.499672:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.499673:0:17940:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788636884.499676:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788636884.499679:0:17940:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788636884.499682:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.499689:0:17940:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788636884.499692:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788636884.499696:0:17940:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:01000000:1.0:1788636884.499720:0:17940:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788636884.499723:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636884.499736:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9cf0339d8000) 00000020:00000080:1.0:1788636884.499749:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788636884.499754:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788636884.499855:0:17940:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788636884.499861:0:17940:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788636884.499866:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e8394a7 00010000:00080000:1.0:1788636884.499904:0:17940:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf01135c800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.126@tcp at head 00010000:00010000:1.0:1788636884.500103:0:17940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788636884.500620:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226075392:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788636884.500701:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.501349:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226075392 00000100:00100000:1.0:1788636884.501360:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226075392 00000100:00100000:1.0:1788636884.501446:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636884.501453:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875521226075392:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788636884.501478:0:17209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:1.0:1788636884.501511:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e8394ae 00000004:00100000:1.0:1788636884.501532:0:17209:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788636884.501538:0:17209:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788636884.502354:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788636884.502361:0:16613:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788636884.502365:0:16613:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788636884.502371:0:16613:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 552 00000100:00080000:2.0:1788636884.502375:0:16613:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788636884.502380:0:16613:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cf002f65000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636884.502412:0:16613:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef033be680 x1875521226075520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788636884.502445:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788636884.502450:0:16613:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788636884.502453:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788636884.502455:0:16613:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788636884.502516:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636884.502539:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226075648:0@lo:400:kworker.0 00000100:00100000:2.0:1788636884.502600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636884.502665:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226075648 00000100:00100000:2.0:1788636884.502671:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226075648 00000100:00100000:2.0:1788636884.502712:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788636884.502719:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226075648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636884.502784:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226075648:12345-0@lo:400:kworker.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636884.502791:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788636884.502856:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cef033bed80 x1875521226075648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636884.502868:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226075648:0@lo:400:kworker.0 00000100:00100000:0.0:1788636884.503113:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226075520:0@lo:38:kworker.0 00000100:00100000:0.0:1788636884.503147:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1788636884.504037:0:17940:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788636884.504583:0:17940:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1788636884.505511:0:17210:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000040:00080000:3.0:1788636884.507352:0:17940:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636884.507658:0:17940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788636884.507846:0:17940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:1.0:1788636884.510200:0:17210:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788636884.510441:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226075520 00000100:00100000:3.0:1788636884.510452:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226075520 00000100:00100000:1.0:1788636884.510618:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636884.510627:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875521226075520:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788636884.510734:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1875521226075520:12345-0@lo:38:kworker.0 Request processed in 106us (7584us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788636884.510742:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788636884.510849:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788636884.510858:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788636884.510863:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788636884.510866:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226075520:0@lo:38:kworker.0 00000020:00000080:0.0:1788636884.513832:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788636884.513853:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788636884.513894:0:17940:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788636884.513931:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e8394b5 00000100:00080000:0.0:1788636884.513944:0:17940:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788636884.513950:0:17940:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9cf01135c800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636884.513995:0:17940:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0237f800 x1875521226075776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636884.514023:0:17940:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788636884.514219:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226075776:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788636884.514289:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875521226075776 offset 0 length 520: 4 00000020:01000000:0.0:1788636884.514371:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636884.514376:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636884.514378:0:17940:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788636884.514381:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788636884.514384:0:17940:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788636884.514385:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788636884.514387:0:17940:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788636884.514388:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788636884.514391:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636884.514392:0:17940:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788636884.514395:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788636884.514398:0:17940:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788636884.514401:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636884.514402:0:17940:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788636884.514405:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788636884.514409:0:17940:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.126@tcp to nid 0x20000c0a8ca7e (192.168.202.126@tcp) 00000020:01000000:0.0:1788636884.514439:0:17940:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788636884.514441:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636884.514451:0:17940:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9cf03a6099c0) 00000020:00000080:0.0:1788636884.514463:0:17940:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788636884.514468:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788636884.514537:0:17940:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788636884.514545:0:17940:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788636884.514557:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5b741ef42e8394c3 00010000:00080000:0.0:1788636884.514584:0:17940:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf032136000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.126@tcp at head 00010000:00010000:0.0:1788636884.514786:0:17940:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788636884.515219:0:17940:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788636884.515235:0:17940:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788636884.516697:0:17945:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788636884.516704:0:17945:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00080000:3.0:1788636884.518362:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636884.518369:0:16613:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636884.518372:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636884.518375:0:16613:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788636884.519345:0:17940:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636884.520187:0:17940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788636884.520348:0:17940:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788636884.520900:0:17948:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788636884.520915:0:17948:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788636884.521756:0:17940:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788636884.521769:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788636884.521846:0:17940:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788636884.521869:0:17940:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e8394ca 00000100:00080000:3.0:1788636884.521880:0:17940:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636884.521886:0:17940:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cf032136000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636884.521934:0:17940:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcae300 x1875521226075904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636884.521953:0:17940:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788636884.522268:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636884.522272:0:16613:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788636884.522275:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636884.522277:0:16613:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788636884.522349:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226075904:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788636884.522416:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875521226075904 offset 0 length 520: 4 00000020:01000000:3.0:1788636884.522618:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636884.522625:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636884.522627:0:17940:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788636884.522631:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636884.522635:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636884.522636:0:17940:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788636884.522639:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788636884.522641:0:17940:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788636884.522645:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636884.522649:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636884.522651:0:17940:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788636884.522653:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636884.522655:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636884.522656:0:17940:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788636884.522667:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788636884.522692:0:17940:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636884.522695:0:17940:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636884.522696:0:17940:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788636884.522699:0:17940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:2.0:1788636884.525353:0:17209:0:(import.c:65:import_set_state_nolock()) ffff9cf0268f5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636884.525466:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875521226075392:12345-0@lo:38:llog_process_th.0 Request processed in 24009us (24762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636884.525478:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636884.525554:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788636884.525564:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788636884.525573:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788636884.525579:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788636884.525581:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf01135b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788636884.525593:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226075392:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788636884.526153:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636884.526168:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226076032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636884.526214:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636884.526250:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226076032 00000100:00100000:3.0:1788636884.526256:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226076032 00000100:00100000:3.0:1788636884.526303:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636884.526312:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875521226076032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636884.526340:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788636884.526379:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875521226076032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.526386:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636884.526418:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226076032:0@lo:41:osp-pre-0-1.0 00000020:01000000:1.0:1788636884.527224:0:17936:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788636884.527265:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788636884.527327:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37200/0x5b741ef42e83944c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839453 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.527340:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37200/0x5b741ef42e83944c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839453 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636884.527349:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf0113d7000 from 1 10000000:01000000:1.0:1788636884.527352:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788636884.527380:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.527389:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.527397:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636884.527414:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076160:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636884.527467:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.527503:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571240 going to sleep for 11 seconds 00000100:00100000:2.0:1788636884.527691:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226076160 00000100:00100000:2.0:1788636884.527697:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226076160 00000100:00100000:2.0:1788636884.527739:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788636884.527749:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+15:17936:x1875521226076160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636884.527761:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636884.527774:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8394d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8394d1 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.527851:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8394d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8394d1 expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.527863:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8394d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8394d1 expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.527871:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0000, rc 0) 00000100:00100000:2.0:1788636884.527916:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+16:17936:x1875521226076160:12345-0@lo:101:mount.lustre.0 Request processed in 159us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636884.527923:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788636884.528213:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636884.528237:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.528246:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636884.529256:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076288:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788636884.529311:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.529346:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571240 going to sleep for 11 seconds 00000100:00100000:2.0:1788636884.530727:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226076288 00000100:00100000:2.0:1788636884.530739:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226076288 00000100:00100000:2.0:1788636884.530801:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788636884.530836:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+16:17936:x1875521226076288:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788636884.530868:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788636884.530890:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788636884.530894:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788636884.531248:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+16:17936:x1875521226076288:12345-0@lo:256:mount.lustre.0 Request processed in 415us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636884.531329:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788636884.531485:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076288:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788636884.537355:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788636884.537389:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.537403:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636884.537411:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf0113d7000 from 1 10000000:01000000:1.0:1788636884.537413:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636884.537467:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.537476:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.537488:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636884.537515:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636884.538784:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.539273:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571240 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.539502:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226076416 00000100:00100000:3.0:1788636884.539512:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226076416 00000100:00100000:3.0:1788636884.539582:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788636884.539593:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+16:17936:x1875521226076416:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636884.539616:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636884.539636:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8394e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8394df expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.539664:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8394e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8394df expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.539675:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8394e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8394df expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.539696:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8600, rc 0) 00000100:00100000:3.0:1788636884.539749:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17936:x1875521226076416:12345-0@lo:101:mount.lustre.0 Request processed in 158us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.539757:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788636884.540324:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636884.540342:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.540351:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636884.540493:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788636884.540541:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076544:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636884.540575:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.540646:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571000 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.541448:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226076544 00000100:00100000:3.0:1788636884.541455:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226076544 00000100:00100000:3.0:1788636884.541704:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788636884.541716:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+17:17936:x1875521226076544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636884.541874:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+17:17936:x1875521226076544:12345-0@lo:501:mount.lustre.0 Request processed in 160us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.541882:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788636884.541970:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636884.542023:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788636884.542085:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636884.542381:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636884.542515:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226076672 00000100:00100000:1.0:1788636884.542521:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226076672 00000100:00100000:1.0:1788636884.543139:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788636884.543150:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17936:x1875521226076672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636884.543335:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17936:x1875521226076672:12345-0@lo:503:mount.lustre.0 Request processed in 187us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636884.543342:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788636884.543468:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076672:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788636884.544394:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788636884.544492:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788636884.544556:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636884.544592:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.544767:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226076800 00000100:00100000:3.0:1788636884.544773:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226076800 00000100:00100000:3.0:1788636884.544852:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788636884.544860:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17936:x1875521226076800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636884.544961:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17936:x1875521226076800:12345-0@lo:502:mount.lustre.0 Request processed in 102us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.544969:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788636884.545035:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636884.545501:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788636884.545543:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788636884.545562:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788636884.545576:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788636884.545588:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788636884.545600:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788636884.545628:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788636884.545650:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788636884.545664:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788636884.545676:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788636884.545688:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788636884.545715:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636884.545757:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636884.545791:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226076928 00000100:00100000:3.0:1788636884.545796:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226076928 00000100:00100000:3.0:1788636884.545855:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788636884.545863:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17936:x1875521226076928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636884.545932:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17936:x1875521226076928:12345-0@lo:502:mount.lustre.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.545939:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788636884.545972:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0268d13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.546273:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226076928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636884.546316:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788636884.546324:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788636884.547361:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636884.547372:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.547375:0:17950:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788636884.547384:0:17950:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf0113d7000 00000020:00000080:1.0:1788636884.547386:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788636884.547394:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636884.547396:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.547397:0:17950:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788636884.547408:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636884.547411:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.547413:0:17950:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788636884.547416:0:17950:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf0113d7000 00000020:00000080:1.0:1788636884.547418:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788636884.547490:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636884.547494:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.547495:0:17950:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788636884.547497:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636884.547499:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.547501:0:17950:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788636884.547504:0:17950:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf0113d7000 00000020:00000080:1.0:1788636884.547506:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788636884.547538:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636884.547542:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.547543:0:17950:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788636884.547546:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636884.547548:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.547549:0:17950:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788636884.547552:0:17950:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf0113d7000 00000020:00000080:1.0:1788636884.547554:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788636884.547580:0:17950:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636884.547583:0:17950:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636884.547584:0:17950:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788636884.547587:0:17950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788636884.547872:0:17936:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788636884.547899:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636884.547923:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.547936:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636884.547983:0:17936:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788636884.547996:0:17936:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf0113d7000 10000000:01000000:3.0:1788636884.547999:0:17936:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf0113d7000 10000000:01000000:3.0:1788636884.548010:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788636884.548017:0:17936:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf0113d7000 from 1 10000000:01000000:3.0:1788636884.548019:0:17936:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788636884.548052:0:17936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8200/0x5b741ef42e8394ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.548060:0:17936:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8200/0x5b741ef42e8394ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.548326:0:17936:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8200/0x5b741ef42e8394ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636884.548348:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788636884.548406:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636884.548460:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226077056 00000100:00100000:3.0:1788636884.548466:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226077056 00000100:00100000:3.0:1788636884.548507:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788636884.548517:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17936:x1875521226077056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636884.548650:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636884.548665:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0061f8000/0x5b741ef42e8394f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8394ed expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.548690:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0061f8000/0x5b741ef42e8394f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8394ed expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.548701:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0061f8000/0x5b741ef42e8394f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8394ed expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.548711:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8000, rc 0) 00000100:00100000:3.0:1788636884.548743:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077056:12345-0@lo:101:mount.lustre.0 Request processed in 228us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.548758:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788636884.548804:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0268d1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.548855:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636884.548870:0:17936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8200/0x5b741ef42e8394ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8394f4 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.548879:0:17936:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8200/0x5b741ef42e8394ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8394f4 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636884.553434:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788636884.554727:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636884.555449:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788636884.555481:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788636884.555497:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788636884.555509:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788636884.555520:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788636884.555833:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788636884.555858:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788636884.555869:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788636884.555880:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788636884.555890:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788636884.555901:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788636884.555911:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788636884.555922:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788636884.555932:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788636884.555942:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788636884.555952:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788636884.555979:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788636884.556005:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788636884.556018:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788636884.556042:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788636884.556056:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788636884.556080:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788636884.556095:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788636884.556107:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788636884.556118:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788636884.556131:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788636884.556142:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788636884.556154:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788636884.556187:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788636884.556193:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788636884.556290:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636884.556358:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636884.556415:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00937bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636884.556833:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226077184 00000100:00100000:2.0:1788636884.556841:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226077184 00000100:00100000:2.0:1788636884.556891:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788636884.556900:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636884.557033:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077184:12345-0@lo:501:mount.lustre.0 Request processed in 134us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636884.557053:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788636884.557435:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636884.557479:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788636884.557538:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636884.557561:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef033aec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.557746:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226077312 00000100:00100000:3.0:1788636884.557752:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226077312 00000100:00100000:3.0:1788636884.557798:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636884.557825:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077312:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636884.557928:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077312:12345-0@lo:503:mount.lustre.0 Request processed in 122us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.557935:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636884.557979:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077312:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788636884.559001:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788636884.559306:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636884.559371:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636884.559412:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0268d1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636884.559671:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226077440 00000100:00100000:0.0:1788636884.559684:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226077440 00000100:00100000:0.0:1788636884.559731:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788636884.559739:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788636884.559895:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077440:12345-0@lo:502:mount.lustre.0 Request processed in 155us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636884.559903:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788636884.560284:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636884.560517:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788636884.560708:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788636884.560725:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788636884.560738:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788636884.560751:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788636884.560764:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788636884.560776:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788636884.560788:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788636884.560801:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788636884.561249:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788636884.561271:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788636884.561284:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788636884.561295:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788636884.561306:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788636884.561319:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788636884.561330:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788636884.561341:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788636884.561369:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788636884.561384:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788636884.561398:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788636884.561412:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788636884.561457:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788636884.561472:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788636884.561487:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788636884.561502:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788636884.561514:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788636884.563862:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788636884.563920:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788636884.563936:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788636884.563950:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788636884.563963:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788636884.563976:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788636884.564002:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788636884.564036:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788636884.564062:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788636884.566784:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788636884.566801:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788636884.566835:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788636884.566870:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788636884.566883:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788636884.566896:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788636884.566908:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788636884.566921:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788636884.566934:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788636884.566947:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788636884.566959:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788636884.566972:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788636884.566986:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788636884.568633:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636884.568722:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636884.568774:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008ac8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636884.569299:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226077568 00000100:00100000:2.0:1788636884.569308:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226077568 00000100:00100000:2.0:1788636884.569353:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788636884.569362:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636884.569494:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077568:12345-0@lo:502:mount.lustre.0 Request processed in 132us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636884.569502:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788636884.570345:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636884.571438:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788636884.571480:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788636884.571518:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636884.571970:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636884.572307:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226077696 00000100:00100000:2.0:1788636884.572314:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226077696 00000100:00100000:2.0:1788636884.572357:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788636884.572365:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636884.572474:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077696:12345-0@lo:502:mount.lustre.0 Request processed in 109us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636884.572482:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788636884.572618:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008ac8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.572636:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636884.572687:0:17936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788636884.572696:0:17936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788636884.580233:0:17953:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788636884.580255:0:17953:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9cef034b0000) 00000020:00000080:3.0:1788636884.580278:0:17953:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788636884.580391:0:17953:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf0113d7000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788636884.580396:0:17953:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf0113d7000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788636884.580399:0:17953:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf0113d7000 3 00010000:00080000:3.0:1788636884.580443:0:17953:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef0406a800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.126@tcp at head 00010000:00010000:3.0:1788636884.587357:0:17953:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788636884.599506:0:17953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788636884.603024:0:17953:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788636884.603044:0:17953:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5b741ef42e839502 00000100:00080000:3.0:1788636884.603056:0:17953:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636884.603183:0:17953:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9cef0406a800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636884.603230:0:17953:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcadf80 x1875521226077824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788636884.603284:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521226077824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788636884.603356:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636884.603433:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226077824 00000100:00100000:3.0:1788636884.603439:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226077824 00000100:00100000:3.0:1788636884.603482:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636884.603488:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875521226077824:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788636884.603511:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:3.0:1788636884.603959:0:17205:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5b741ef42e839509 00000004:00100000:3.0:1788636884.603974:0:17205:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788636884.604665:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9cf032131800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636884.604745:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875521226077824:12345-0@lo:38:llog_process_th.0 Request processed in 1254us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.604754:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788636884.604833:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf03fcadf80 x1875521226077824/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636884.605736:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788636884.605747:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788636884.605757:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788636884.605762:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788636884.605766:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef0406a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788636884.605773:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875521226077824:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788636884.605825:0:17953:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788636884.606959:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636884.606964:0:16613:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636884.606967:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636884.606970:0:16613:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788636884.611786:0:17953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788636884.611883:0:17936:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788636884.611910:0:17936:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788636884.611930:0:17936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8200/0x5b741ef42e8394ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8394f4 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.611943:0:17936:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8200/0x5b741ef42e8394ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8394f4 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788636884.613980:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788636884.614826:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788636884.614828:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636884.614830:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636884.614831:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636884.614834:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636884.614915:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788636884.614917:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636884.614918:0:17936:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788636884.614922:0:17936:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788636884.614926:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788636884.614927:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788636884.614928:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636884.614929:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636884.614930:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636884.614932:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636884.614933:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788636884.614934:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636884.614935:0:17936:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788636884.614964:0:17936:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788636884.615464:0:17936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788636884.615730:0:17936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636884.615784:0:17936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0268d13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636884.616685:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226077952 00000100:00100000:2.0:1788636884.616694:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226077952 00000100:00100000:2.0:1788636884.616753:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788636884.616763:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077952:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788636884.616796:0:17199:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788636884.616822:0:17199:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788636884.643914:0:17184:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788636884.644653:0:17199:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788636884.644676:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788636884.644851:0:17220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788636884.644857:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788636884.644878:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.644910:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83940d expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.644917:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8394d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8394d1 expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.644925:0:17220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.644964:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8394d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8394d1 expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.644979:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8394d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8394d1 expref: 18 pid: 17199 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636884.645145:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226078080:0@lo:104: 00000100:00100000:2.0:1788636884.645211:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788636884.645270:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83940d expref: 18 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636884.645278:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83940d expref: 18 pid: 17199 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636884.645286:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226078208:0@lo:104: 00000100:00100000:2.0:1788636884.645307:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636884.645325:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf007725b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.645393:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226078080 00000100:00100000:3.0:1788636884.645400:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226078080 00000100:00100000:3.0:1788636884.645450:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226078208 00000100:00100000:3.0:1788636884.645454:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226078208 00000100:00100000:3.0:1788636884.645469:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636884.645478:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+4:17220:x1875521226078080:12345-0@lo:104: 00010000:00010000:3.0:1788636884.645491:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.645563:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636884.645570:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+4:17220:x1875521226078080:12345-0@lo:104: Request processed in 93us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.645577:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636884.645594:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636884.645609:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:17220:x1875521226078208:12345-0@lo:104: 00010000:00010000:3.0:1788636884.645617:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.645653:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788636884.645658:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:17220:x1875521226078208:12345-0@lo:104: Request processed in 51us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.645663:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788636884.645795:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226078080:0@lo:104: 00000100:00100000:2.0:1788636884.645829:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226078208:0@lo:104: 00010000:00010000:2.0:1788636884.645855:0:17220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636884.646349:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:17936:x1875521226077952:12345-0@lo:253:mount.lustre.0 Request processed in 29586us (30618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.646359:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:0.0:1788636884.646465:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636884.646473:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.646481:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37a00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636884.646485:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.646494:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636884.646502:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636884.646508:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788636884.646826:0:17936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:17936:1875521226077952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788636884.646838:0:17936:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00010000:00010000:0.0:1788636884.647191:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.647200:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636884.647225:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.647232:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37a00/0x5b741ef42e8394d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8394d8 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.647260:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636884.647264:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.647271:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9400 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:0.0:1788636884.647274:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.647281:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636884.647287:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636884.647292:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636884.647308:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.647314:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636884.647320:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.647328:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83940d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839414 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636884.647342:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636884.647343:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636884.647345:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636884.647355:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636884.647377:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226078464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636884.647474:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636884.647513:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636884.647519:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226078336:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1788636884.647606:0:17936:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636884.647609:0:17936:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788636884.647610:0:17936:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636884.647611:0:17936:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636884.647613:0:17936:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636884.647615:0:17936:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636884.647616:0:17936:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636884.647618:0:17936:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636884.647619:0:17936:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788636884.647637:0:17936:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788636884.648210:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226078464 00000100:00100000:1.0:1788636884.648218:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226078464 00010000:00010000:1.0:1788636884.648253:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83940d expref: 18 pid: 17199 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636884.648290:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636884.648298:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+18:3647:x1875521226078464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636884.648310:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636884.648326:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839414 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83940d expref: 18 pid: 17199 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.648335:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83940d expref: 18 pid: 17199 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.648349:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83940d expref: 18 pid: 17199 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636884.648362:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636884.648405:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+17:3647:x1875521226078464:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636884.648411:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636884.649241:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636884.649334:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226078464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636884.657192:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226078336 00000100:00100000:3.0:1788636884.657210:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226078336 00010000:00010000:3.0:1788636884.657271:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8394d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8394d1 expref: 17 pid: 17199 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636884.657349:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636884.657360:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7a34533-966f-4857-8403-9471b802ebf2+17:3647:x1875521226078336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636884.657376:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636884.657382:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8394d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8394d1 expref: 17 pid: 17199 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657396:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8394d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8394d1 expref: 17 pid: 17199 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657414:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8394d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8394d1 expref: 17 pid: 17199 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657437:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657454:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788636884.657471:0:17191:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012614678s 00010000:00010000:3.0:1788636884.657476:0:17191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657483:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657489:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657496:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657502:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636884.657506:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657514:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657542:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657553:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636884.657576:0:17220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657584:0:17220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636884.657596:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e839510 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636884.657679:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7a34533-966f-4857-8403-9471b802ebf2+16:3647:x1875521226078336:12345-0@lo:103:ldlm_bl.0 Request processed in 321us (8439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.657686:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636884.657730:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226078336:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1788636884.676224:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788636884.676399:0:17962:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788636884.676403:0:17962:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788636884.676722:0:17963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788636884.676972:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788636884.679220:0:17963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636884.684306:0:17963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788636884.684404:0:17963:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788636884.685186:0:17964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875521226078592:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788636884.685254:0:17964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.685291:0:17964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10180 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.685343:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226078592 00000100:00100000:3.0:1788636884.685352:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226078592 00000100:00100000:3.0:1788636884.685394:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636884.685402:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17964:x1875521226078592:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788636884.685514:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17964:x1875521226078592:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.685523:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636884.685707:0:17964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875521226078592:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788636884.685746:0:17964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788636884.685769:0:17964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875521226078720:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788636884.685796:0:17964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.685836:0:17964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636884.686384:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226078720 00000100:00100000:0.0:1788636884.686390:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226078720 00000100:00100000:0.0:1788636884.686439:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636884.686447:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17964:x1875521226078720:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788636884.686752:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17964:x1875521226078720:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 305us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636884.686759:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:01000000:0.0:1788636884.687195:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788636884.687234:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788636884.687852:0:17964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875521226078720:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788636884.687931:0:17964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17964:1875521226078848:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788636884.687978:0:17964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.688020:0:17964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636884.688283:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226078848 00000100:00100000:3.0:1788636884.688289:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226078848 00000004:00000080:0.0:1788636884.688485:0:17936:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788636884.688494:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788636884.688575:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636884.689712:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788636884.691344:0:17936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788636884.691408:0:17936:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788636884.691716:0:17936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788636884.693048:0:17936:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1788636884.693625:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00000100:00100000:2.0:1788636884.695708:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636884.695726:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17964:x1875521226078848:12345-0@lo:900:lod0001_rec0000.0 00010000:00080000:1.0:1788636884.696003:0:17964:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf01291bb80 x1875521226078848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788636900 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636884.696026:0:17964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17964:1875521226078848:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788636884.696108:0:17964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875521226078976:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788636884.696147:0:17964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636884.696173:0:17964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e10180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636884.696336:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17964:x1875521226078848:12345-0@lo:900:lod0001_rec0000.0 Request processed in 615us (8357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636884.696345:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00000004:0.0:1788636884.696764:0:17936:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788636884.696971:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226078976 00000100:00100000:3.0:1788636884.696979:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226078976 00000100:00100000:3.0:1788636884.697030:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788636884.697038:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17964:x1875521226078976:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788636884.697337:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17964:x1875521226078976:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 298us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636884.697343:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636884.697463:0:17964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291bb80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17964:1875521226078976:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788636884.697515:0:17964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636884.700935:0:17964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788636884.701028:0:17964:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788636884.701033:0:17964:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1788636884.715792:0:17936:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788636884.716162:0:17936:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb254056fb988 00100000:10000000:0.0:1788636884.716171:0:17936:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788636884.723102:0:17936:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788636884.723143:0:17936:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.126@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788636884.723161:0:17936:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788636884.723192:0:17936:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788636884.724474:0:17936:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788636884.726478:0:17936:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788636885.087467:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788636885.717785:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788636885.718206:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:3.0:1788636886.102012:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788636886.614618:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788636886.614626:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf0113d7000 from 8 10000000:01000000:3.0:1788636886.614631:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788636886.614682:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636886.614697:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636886.614709:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636886.614735:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226079104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636886.614842:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636886.614902:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00350dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636886.614991:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226079104 00000100:00100000:2.0:1788636886.614999:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226079104 00000100:00100000:2.0:1788636886.615048:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788636886.615056:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+16:17201:x1875521226079104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636886.615086:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636886.615100:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e83951e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e839517 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636886.615123:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e83951e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e839517 expref: 17 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636886.615133:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e83951e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e839517 expref: 17 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636886.615142:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0600, rc 0) 00000100:00100000:2.0:1788636886.615190:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+17:17201:x1875521226079104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636886.615197:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788636886.616460:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226079104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636886.616485:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636886.616497:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636886.616568:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226079232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788636886.616619:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636886.616662:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00350dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636886.616733:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226079232 00000100:00100000:2.0:1788636886.616739:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226079232 00000100:00100000:2.0:1788636886.616785:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788636886.616793:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+17:17201:x1875521226079232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788636886.616847:0:17199:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788636886.616864:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788636886.616867:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788636886.616960:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+17:17201:x1875521226079232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636886.616967:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788636886.617124:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226079232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788636886.617163:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788636886.617174:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636886.617182:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636886.617192:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788636886.617195:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cef03105000 from 8 10000000:01000000:3.0:1788636886.617197:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788636886.617218:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636886.617226:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636886.617235:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636886.617247:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226079360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636886.617269:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636886.617293:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00350dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636886.617341:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226079360 00000100:00100000:0.0:1788636886.617346:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226079360 00000100:00100000:0.0:1788636886.617375:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788636886.617382:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17201:x1875521226079360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636886.617390:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636886.617400:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e83952c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e839525 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636886.617417:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e83952c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e839525 expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636886.617437:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e83952c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e839525 expref: 18 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636886.617446:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6e00, rc 0) 00000100:00100000:0.0:1788636886.617479:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:17201:x1875521226079360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636886.617485:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788636886.617546:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226079360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636886.617556:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636886.617563:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636886.617599:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226079488:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788636886.617633:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636886.617653:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00350dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636886.617701:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226079488 00000100:00100000:0.0:1788636886.617711:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226079488 00000100:00100000:0.0:1788636886.617742:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788636886.617748:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+18:17201:x1875521226079488:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788636886.617761:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788636886.617774:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788636886.617777:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788636886.618072:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+18:17201:x1875521226079488:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 323us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636886.618080:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788636886.618153:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226079488:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788636886.618189:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788636886.618196:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636886.618204:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636886.741050:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00000040:00080000:3.0:1788636886.741916:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788636887.125396:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636887.767840:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:0.0:1788636888.151590:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636888.793073:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 0 seconds 00010000:00010000:0.0:1788636889.174691:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636889.750130:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226079616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636889.750199:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636889.750284:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226079616 00000100:00100000:0.0:1788636889.750292:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226079616 00000100:00100000:0.0:1788636889.750340:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636889.750350:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226079616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636889.750383:0:17946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788636889.750428:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226079616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636889.750434:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636889.750502:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226079616:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788636889.752823:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788636889.752829:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788636889.752833:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636889.752845:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9cf002f65000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636889.752867:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf01291b800 x1875521226079872/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636889.752885:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636889.752889:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788636889.752903:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636889.752906:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788636889.752929:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636889.752933:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788636889.752936:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636889.752939:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788636889.752971:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226080000:0@lo:400:kworker.0 00000100:00100000:1.0:1788636889.753041:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636889.753089:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636889.753096:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226080128:0@lo:400:kworker.0 00000100:00100000:1.0:1788636889.753117:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636889.753150:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226080000 00000100:00100000:1.0:1788636889.753156:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226080000 00000100:00100000:1.0:1788636889.753194:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226080128 00000100:00100000:1.0:1788636889.753198:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226080128 00000100:00100000:1.0:1788636889.753213:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636889.753222:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226080000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636889.753269:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226080000:12345-0@lo:400:kworker.0 Request processed in 47us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636889.753276:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636889.753291:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636889.753297:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226080128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636889.753325:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226080128:12345-0@lo:400:kworker.0 Request processed in 28us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636889.753331:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636889.753357:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226079872:0@lo:38:kworker.0 00000100:00100000:1.0:1788636889.753384:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636889.753420:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226079872 00000100:00100000:1.0:1788636889.753423:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226079872 00000100:00100000:1.0:1788636889.753453:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788636889.753458:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1875521226079872:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788636889.753504:0:17209:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 558 last 0 00000020:00000080:1.0:1788636889.753537:0:17209:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e839533 00000004:00100000:1.0:1788636889.753555:0:17209:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788636889.753561:0:17209:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:1.0:1788636889.753641:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf01291a680 x1875521226080128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636889.753653:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226080128:0@lo:400:kworker.0 00010000:00080000:1.0:1788636889.753663:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf01291bb80 x1875521226080000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636889.753671:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226080000:0@lo:400:kworker.0 00000100:00100000:1.0:1788636889.753695:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636889.753703:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226079744:0@lo:400:kworker.0 00000100:00100000:1.0:1788636889.753732:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636889.753762:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226079744 00000100:00100000:1.0:1788636889.753766:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226079744 00000100:00100000:1.0:1788636889.753792:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788636889.753799:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:3648:x1875521226079744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636889.753852:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:3648:x1875521226079744:12345-0@lo:400:kworker.0 Request processed in 54us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636889.753859:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788636889.753894:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226079744:0@lo:400:kworker.0 00000100:00080000:1.0:1788636889.770997:0:17209:0:(import.c:65:import_set_state_nolock()) ffff9cef0361e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636889.771175:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875521226079872:12345-0@lo:38:kworker.0 Request processed in 17712us (17786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636889.771186:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788636889.771300:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788636889.771310:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788636889.771316:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788636889.771319:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf002f65000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788636889.771353:0:3645:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000dbf26909): req@ffff9cef033bdf80 x1875521226072448/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636889.771373:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226079872:0@lo:38:kworker.0 00000100:00100000:0.0:1788636889.771459:0:17246:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636889.771484:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040a7e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636889.771500:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226072448 00000100:00100000:0.0:1788636889.771506:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226072448 00000100:00100000:1.0:1788636889.771674:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636889.771685:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226080256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636889.771717:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636889.771745:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226080256 00000100:00100000:1.0:1788636889.771749:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226080256 00000100:00100000:1.0:1788636889.771769:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788636889.771776:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17246:x1875521226072448:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788636889.771871:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17246:x1875521226072448:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636889.771878:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788636889.773994:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788636889.774019:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226080256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788636889.774054:0:17946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788636889.774136:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226080256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636889.774143:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788636889.774201:0:17246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17246:1875521226072448:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788636889.774244:0:17246:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788636889.774287:0:17246:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17246:1875521226080384:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788636889.774328:0:17246:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636889.774361:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636889.774381:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226080384 00000100:00100000:1.0:1788636889.774386:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226080384 00000100:00100000:1.0:1788636889.774413:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788636889.774418:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17246:x1875521226080384:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788636889.774534:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17246:x1875521226080384:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 115us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636889.774724:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226080256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636889.778181:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788636889.778280:0:17246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17246:1875521226080384:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788636889.778396:0:17246:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17246:1875521226080512:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788636889.778467:0:17246:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636889.778505:0:17246:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf011e103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636889.778526:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226080512 00000100:00100000:1.0:1788636889.778532:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226080512 00000100:00100000:1.0:1788636889.779307:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788636889.779318:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17246:x1875521226080512:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788636889.779406:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17246:x1875521226080512:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 89us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636889.779413:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788636889.779456:0:17246:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17246:1875521226080512:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788636889.779505:0:17246:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636889.789466:0:17246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788636889.789749:0:17246:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:1.0:1788636889.789755:0:17246:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788636890.197151:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788636890.646173:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788636890.897257:0:18207:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788636891.232720:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788636892.170761:0:18259:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788636892.171081:0:18259:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788636892.265663:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636893.282390:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788636893.492291:0:18311:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788636893.492931:0:18311:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788636893.844948:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636878/real 1788636878] req@ffff9cf012918700 x1875521226073600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636893 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636893.844993:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf012918700 x1875521226073600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636893 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636893.845005:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636878/real 1788636878] req@ffff9cf01291b480 x1875521226073728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636893 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636893.845017:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf01291b480 x1875521226073728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636893 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788636893.845043:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf015a7a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636893.845074:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788636893.845080:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226073600:0@lo:8:kworker.0 00000100:00080000:0.0:1788636893.845086:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636893.845093:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788636893.845096:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226073728:0@lo:8:kworker.0 00000100:00080000:2.0:1788636893.847432:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788636893.847524:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788636893.847530:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf015a7a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788636893.847543:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:2.0:1788636893.847551:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788636893.847562:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf015a7a000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636893.847592:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef033be300 x1875521226080896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788636893.847608:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788636893.847612:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788636893.847614:0:36:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788636893.847617:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:2.0:1788636893.847620:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788636893.847624:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf032424800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636893.847635:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef033bdf80 x1875521226081024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788636893.847658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788636893.847662:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788636893.847665:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788636893.847669:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788636893.848329:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226081280:0@lo:400:kworker.0 00000100:00100000:0.0:1788636893.848538:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636893.848636:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788636893.848644:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226080640:0@lo:400:kworker.0 00000100:00100000:0.0:1788636893.848679:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636893.848711:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226081408:0@lo:400:kworker.0 00000100:00100000:0.0:1788636893.848747:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636893.848788:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226080640 00000100:00100000:0.0:1788636893.848798:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226080640 00000100:00100000:0.0:1788636893.848905:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636893.848918:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:3648:x1875521226080640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636893.848984:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:3648:x1875521226080640:12345-0@lo:400:kworker.0 Request processed in 68us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636893.848993:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636893.849040:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226081408 00000100:00100000:0.0:1788636893.849044:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226081408 00000100:00100000:0.0:1788636893.849075:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788636893.849081:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226081408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636893.849114:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226081408:12345-0@lo:400:kworker.0 Request processed in 34us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636893.849120:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788636893.849151:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226080896:0@lo:8:kworker.0 00000400:00000100:0.0:1788636893.849174:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875521226080896 offset 0 length 520: 4 00000100:00100000:0.0:1788636893.849652:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226081024:0@lo:8:kworker.0 00000400:00000100:0.0:1788636893.849687:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875521226081024 offset 0 length 520: 4 00000100:00100000:0.0:1788636893.849739:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226080640:0@lo:400:kworker.0 00010000:00080000:0.0:1788636893.849771:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cef033bdc00 x1875521226081408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636893.849784:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226081408:0@lo:400:kworker.0 00000100:00100000:2.0:1788636893.849916:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226081280 00000100:00100000:2.0:1788636893.849922:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226081280 00000100:00100000:2.0:1788636893.849975:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636893.849984:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226081280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636893.850044:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226081280:12345-0@lo:400:kworker.0 Request processed in 62us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636893.850051:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788636893.850154:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226081280:0@lo:400:kworker.0 00000100:00100000:3.0:1788636893.851612:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226081152:0@lo:400:kworker.0 00000100:00100000:3.0:1788636893.851698:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636893.851743:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636893.851751:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226080768:0@lo:400:kworker.0 00000100:00100000:3.0:1788636893.851780:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636893.851844:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226081152 00000100:00100000:3.0:1788636893.851853:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226081152 00000100:00100000:3.0:1788636893.851906:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636893.851917:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226081152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636893.851978:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226081152:12345-0@lo:400:kworker.0 Request processed in 64us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636893.852007:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788636893.852052:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cef033be680 x1875521226081152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636893.852068:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226081152:0@lo:400:kworker.0 00000100:00100000:0.0:1788636893.852282:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226080768 00000100:00100000:0.0:1788636893.852287:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226080768 00000100:00100000:0.0:1788636893.852334:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636893.852343:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875521226080768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636893.852391:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875521226080768:12345-0@lo:400:kworker.0 Request processed in 50us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636893.852398:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636893.852435:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226080768:0@lo:400:kworker.0 00010000:00010000:1.0:1788636894.298802:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788636894.680072:0:18359:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf0ac4080 20000000:00000080:3.0:1788636894.680100:0:18359:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf004b35800 uarg=0000000000000000 20000000:01000000:3.0:1788636894.680149:0:18359:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788636894.680156:0:18359:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788636894.680161:0:18359:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788636894.681641:0:18360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788636894.681959:0:18359:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788636894.691141:0:18359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788636894.691186:0:18359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636894.691271:0:18359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8393e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8393dc expref: 17 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636894.691336:0:18359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8394e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8394df expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636894.691346:0:18359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636894.691544:0:18359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8394e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8394df expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636894.692037:0:18359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8394e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8394df expref: 17 pid: 17198 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636894.692079:0:18359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18359:1875521226081536:0@lo:104: 00000100:00100000:3.0:1788636894.692167:0:18359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636894.692676:0:18359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8393e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8393dc expref: 17 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636894.692688:0:18359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8393e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8393dc expref: 17 pid: 17199 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636894.692698:0:18359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18359:1875521226081664:0@lo:104: 00000100:00100000:3.0:1788636894.692722:0:18359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636894.693741:0:18359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788636894.693974:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226081536 00000100:00100000:1.0:1788636894.693986:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226081536 00000100:00100000:1.0:1788636894.694039:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226081664 00000100:00100000:1.0:1788636894.694043:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226081664 00000100:00100000:1.0:1788636894.694059:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636894.694070:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7a34533-966f-4857-8403-9471b802ebf2+4:18359:x1875521226081536:12345-0@lo:104: 00010000:00010000:1.0:1788636894.694087:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694206:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636894.694213:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7a34533-966f-4857-8403-9471b802ebf2+4:18359:x1875521226081536:12345-0@lo:104: Request processed in 146us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636894.694221:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636894.694242:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636894.694248:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7a34533-966f-4857-8403-9471b802ebf2+3:18359:x1875521226081664:12345-0@lo:104: 00010000:00010000:1.0:1788636894.694256:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694305:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788636894.694310:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7a34533-966f-4857-8403-9471b802ebf2+3:18359:x1875521226081664:12345-0@lo:104: Request processed in 63us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636894.694317:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788636894.694336:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636894.694342:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694349:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37e00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636894.694471:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694483:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636894.694491:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636894.694498:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636894.694620:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694628:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636894.694656:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694663:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8394df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8394e6 expref: -99 pid: 17936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694679:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636894.694682:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694688:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1400 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636894.694691:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694698:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636894.694704:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636894.694709:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636894.694725:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694731:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636894.694737:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694753:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1400/0x5b741ef42e8393dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8393e3 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.694770:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636894.694772:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636894.694773:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636894.694799:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226081792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636894.694874:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636894.694910:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636894.694916:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226081920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636894.694959:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636894.694989:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226081792 00000100:00100000:1.0:1788636894.694994:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226081792 00010000:00010000:1.0:1788636894.695018:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8394e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8394df expref: 18 pid: 17198 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636894.695043:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226081920 00000100:00100000:1.0:1788636894.695046:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226081920 00010000:00010000:1.0:1788636894.695058:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8393e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8393dc expref: 19 pid: 17199 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636894.695072:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636894.695079:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+19:3646:x1875521226081792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636894.695092:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636894.695098:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8394e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8394df expref: 19 pid: 17198 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695110:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8394e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8394df expref: 19 pid: 17198 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695137:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636894.695168:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+19:3646:x1875521226081792:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636894.695176:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636894.695189:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636894.695196:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+18:3646:x1875521226081920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636894.695203:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636894.695209:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8393e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8393dc expref: 18 pid: 17199 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695217:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8393e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8393dc expref: 18 pid: 17199 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695230:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695240:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695256:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695265:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695272:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695286:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695301:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636894.695306:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695315:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695324:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636894.695335:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636894.695690:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636894.697156:0:18359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8394e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8394df expref: 18 pid: 17198 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636894.697181:0:18359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18359:1875521226081536:0@lo:104: 00010000:00010000:3.0:1788636894.697206:0:18359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8393e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8393dc expref: 17 pid: 17199 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636894.697216:0:18359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18359:1875521226081664:0@lo:104: 00010000:00010000:3.0:1788636894.697245:0:18359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636894.697257:0:18359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636894.697264:0:18359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636894.697295:0:18359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0061f9a00/0x5b741ef42e83953a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636894.701012:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226081920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636894.701034:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226081792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636894.701486:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+16:3646:x1875521226081920:12345-0@lo:103:ldlm_bl.0 Request processed in 6286us (6522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636894.701502:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788636894.869087:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226082048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636894.869195:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636894.869397:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226082048 00000100:00100000:2.0:1788636894.869410:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226082048 00000100:00100000:2.0:1788636894.869496:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788636894.869510:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521226082048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636894.869578:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788636894.869656:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875521226082048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636894.869665:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788636894.869732:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226082048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636894.870940:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226082176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636894.871013:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636894.871123:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226082176 00000100:00100000:3.0:1788636894.871132:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226082176 00000100:00100000:3.0:1788636894.871200:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788636894.871211:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226082176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636894.871247:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788636894.871318:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226082176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636894.871325:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788636894.871721:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226082176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636894.873621:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636884/real 1788636884] req@ffff9cf03fcae300 x1875521226075904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636894 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636894.873659:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf03fcae300 x1875521226075904/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636894 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636894.873671:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636884/real 1788636884] req@ffff9cef0237f800 x1875521226075776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636894 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636894.873684:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cef0237f800 x1875521226075776/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636894 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788636894.873707:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636894.873732:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788636894.873736:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226075904:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788636894.873742:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf01135c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636894.873749:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788636894.873752:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226075776:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788636894.873981:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636894.873988:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636894.873991:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636894.873995:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636894.874058:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636894.874062:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788636894.874066:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cf01135c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636894.874073:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:3.0:1788636894.874080:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788636894.874095:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9cf01135c800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636894.874121:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcad880 x1875521226082432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636894.874133:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636894.874136:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788636894.874138:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636894.874141:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:3.0:1788636894.874144:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788636894.874147:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cf032136000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636894.874159:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcafb80 x1875521226082560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788636894.874194:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226082688:0@lo:400:kworker.0 00000100:00100000:3.0:1788636894.874288:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636894.874326:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636894.874333:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226082304:0@lo:400:kworker.0 00000100:00100000:3.0:1788636894.874644:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636894.874684:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226082688 00000100:00100000:3.0:1788636894.874693:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226082688 00000100:00100000:3.0:1788636894.874745:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226082304 00000100:00100000:3.0:1788636894.874749:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226082304 00000100:00100000:3.0:1788636894.874767:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636894.874777:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226082688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636894.874865:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226082688:12345-0@lo:400:kworker.0 Request processed in 88us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636894.874872:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636894.874890:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636894.874907:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226082304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636894.874935:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226082304:12345-0@lo:400:kworker.0 Request processed in 30us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636894.874942:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788636894.875000:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf03fcaca80 x1875521226082304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636894.875014:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226082304:0@lo:400:kworker.0 00010000:00080000:3.0:1788636894.875024:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf03fcace00 x1875521226082688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636894.875031:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226082688:0@lo:400:kworker.0 00000100:00100000:2.0:1788636894.876346:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226082432:0@lo:8:kworker.0 00000400:00000100:2.0:1788636894.876424:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875521226082432 offset 0 length 520: 4 00000100:00100000:2.0:1788636894.876473:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226082560:0@lo:8:kworker.0 00000400:00000100:2.0:1788636894.876498:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875521226082560 offset 0 length 520: 4 00010000:00010000:1.0:1788636895.318397:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788636895.382502:0:17937:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788636896.340990:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788636896.725901:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788636896.725914:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf0113d7000 from 13 10000000:01000000:1.0:1788636896.725922:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636896.725986:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636896.726002:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636896.726018:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636896.726054:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226082816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636896.726165:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636896.728043:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00823f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636896.728437:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226082816 00000100:00100000:0.0:1788636896.728451:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226082816 00000100:00100000:0.0:1788636896.728546:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788636896.728568:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+16:17201:x1875521226082816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636896.728589:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636896.728616:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839548 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e839541 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636896.728668:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e839541 expref: 17 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636896.728680:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e839541 expref: 17 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636896.728691:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7200, rc 0) 00000100:00100000:0.0:1788636896.728771:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+17:17201:x1875521226082816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (2606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636896.728779:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788636896.728992:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226082816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636896.729014:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636896.729024:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636896.729124:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226082944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636896.729161:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636896.729184:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00823f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636896.729342:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226082944 00000100:00100000:0.0:1788636896.729347:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226082944 00000100:00100000:0.0:1788636896.729381:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788636896.729389:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17201:x1875521226082944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636896.729546:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+17:17201:x1875521226082944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636896.729554:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788636896.729697:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226082944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636896.729732:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226083072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636896.729783:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636896.729838:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00823f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636896.729886:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226083072 00000100:00100000:0.0:1788636896.729891:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226083072 00000100:00100000:0.0:1788636896.729924:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788636896.729930:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+17:17201:x1875521226083072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636896.730022:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+17:17201:x1875521226083072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636896.730028:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788636896.730307:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226083072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788636896.731328:0:18441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788636896.731638:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788636896.731663:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636896.731679:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636896.731692:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636896.731704:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788636896.731707:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cef03105000 from 13 10000000:01000000:3.0:1788636896.731710:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636896.731755:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636896.731764:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636896.731774:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636896.731837:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226083200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636896.731906:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636896.731949:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788636896.732315:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226083200 00000100:00100000:1.0:1788636896.732326:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226083200 00000100:00100000:1.0:1788636896.732375:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788636896.732385:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+17:17201:x1875521226083200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636896.732400:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636896.732418:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e839556 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83954f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636896.732450:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e839556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83954f expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636896.732486:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e839556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83954f expref: 18 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636896.732496:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37000, rc 0) 00000100:00100000:1.0:1788636896.732555:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+18:17201:x1875521226083200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636896.733316:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226083200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636896.733348:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636896.733361:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636896.733479:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226083328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636896.733534:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636896.733631:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03ab8f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788636896.733756:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788636896.733803:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226083328 00000100:00100000:1.0:1788636896.733834:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226083328 00000100:00100000:0.0:1788636896.742097:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788636896.742134:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:17201:x1875521226083328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636896.742417:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:17201:x1875521226083328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (8880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636896.742427:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788636896.742699:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226083328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636896.742788:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226083456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636896.742902:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636896.742951:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409230c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636896.743217:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226083456 00000100:00100000:0.0:1788636896.743225:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226083456 00000100:00100000:0.0:1788636896.743290:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788636896.743300:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:17201:x1875521226083456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636896.743423:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:17201:x1875521226083456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636896.743431:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788636896.743496:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226083456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788636896.753364:0:18443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788636896.753475:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788636896.753506:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788636896.753524:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636896.753540:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788636896.982137:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788636897.365597:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636898.388981:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636899.460425:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636899.988995:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636899.989025:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226083584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636899.989123:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636899.989179:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226083584 00000100:00100000:3.0:1788636899.989188:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226083584 00000100:00100000:3.0:1788636899.989243:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788636899.989254:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226083584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636899.989297:0:17946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788636899.989343:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226083584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636899.989350:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788636899.989402:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226083584:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788636899.989727:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636899.989732:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788636899.989736:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636899.989740:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788636899.989748:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636899.989752:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788636899.989754:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636899.989758:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788636899.989782:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226083840:0@lo:400:kworker.0 00000100:00100000:1.0:1788636899.989846:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636899.989880:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636899.989886:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226083968:0@lo:400:kworker.0 00000100:00100000:1.0:1788636899.989911:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636899.989949:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226083840 00000100:00100000:1.0:1788636899.989954:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226083840 00000100:00100000:1.0:1788636899.989980:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788636899.989986:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226083840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636899.990023:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226083840:12345-0@lo:400:kworker.0 Request processed in 36us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636899.990030:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788636899.990046:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226083968 00000100:00100000:1.0:1788636899.990049:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226083968 00000100:00100000:1.0:1788636899.990071:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636899.990166:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226084096:0@lo:400:kworker.0 00000100:00100000:0.0:1788636899.990196:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636899.990215:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636899.990220:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226083712:0@lo:400:kworker.0 00000100:00100000:0.0:1788636899.990246:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636899.990276:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226083712 00000100:00100000:0.0:1788636899.990285:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226083712 00000100:00100000:0.0:1788636899.990318:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788636899.990324:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:3648:x1875521226083712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636899.990355:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+18:3648:x1875521226083712:12345-0@lo:400:kworker.0 Request processed in 31us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636899.990361:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788636899.990396:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226083712:0@lo:400:kworker.0 00000100:00100000:1.0:1788636899.991198:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226083968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636899.991272:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226083968:12345-0@lo:400:kworker.0 Request processed in 1195us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636899.991282:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636899.991303:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226084096 00000100:00100000:1.0:1788636899.991309:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226084096 00000100:00100000:1.0:1788636899.991332:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788636899.991338:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226084096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636899.991364:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226084096:12345-0@lo:400:kworker.0 Request processed in 27us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636899.991370:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788636899.991411:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf01291b480 x1875521226083968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636899.991425:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226083968:0@lo:400:kworker.0 00000100:00100000:1.0:1788636899.991438:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226083840:0@lo:400:kworker.0 00010000:00080000:0.0:1788636899.991670:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf00f17b480 x1875521226084096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636899.991682:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226084096:0@lo:400:kworker.0 00000100:00100000:3.0:1788636899.996574:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226084224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636899.996682:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636899.996849:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226084224 00000100:00100000:0.0:1788636899.996861:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226084224 00000100:00100000:0.0:1788636899.996923:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636899.996933:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226084224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636899.996980:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788636899.997040:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226084224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636899.997047:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636899.999699:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226084224:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788636900.501935:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788636900.885739:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788636901.532163:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788636902.442426:0:18707:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788636902.442431:0:18707:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788636902.442432:0:18707:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788636902.442562:0:18707:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cf00324b000 00000020:01000004:2.0:1788636902.442578:0:18707:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788636902.442592:0:18707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788636902.442607:0:18707:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cef0323b380) 00000020:00000080:2.0:1788636902.442624:0:18707:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788636902.543650:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788636902.545653:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788636902.547202:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788636902.548595:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:3.0:1788636902.549484:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788636902.550121:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788636902.550752:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788636902.551174:0:18707:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788636902.555149:0:18707:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788636902.555558:0:18707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788636902.555641:0:18707:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788636902.555654:0:18707:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b741ef42e839564 00000020:01000004:2.0:1788636902.555662:0:18707:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788636902.555686:0:18707:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.126@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788636902.555690:0:18707:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788636902.555697:0:18707:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788636902.555702:0:18707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788636902.555785:0:18707:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cf040b38000) 00000020:00000080:2.0:1788636902.555800:0:18707:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788636902.569932:0:18707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636902.570133:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788636902.570139:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788636902.583171:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788636902.583185:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788636902.585711:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788636902.585737:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788636902.601937:0:18707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788636902.602119:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788636902.602124:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788636902.603358:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788636902.603376:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788636902.685026:0:18707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788636902.687534:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788636902.687543:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788636902.693603:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788636902.693620:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788636902.701436:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788636902.701483:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788636902.712981:0:18707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636902.714753:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788636902.714764:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788636902.715722:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788636902.715731:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788636902.761675:0:18707:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636902.761969:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788636902.761975:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788636902.766237:0:18707:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788636902.766252:0:18707:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788636902.766872:0:18707:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788636902.766901:0:18707:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788636902.766908:0:18707:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788636902.799639:0:18707:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788636902.799690:0:18707:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.126@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788636902.799695:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788636902.799697:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788636902.799698:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636902.799699:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636902.799700:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636902.799701:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636902.799703:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636902.799711:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636902.799712:0:18707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788636902.799716:0:18707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788636902.799718:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788636902.799719:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788636902.799720:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636902.799721:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636902.799722:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636902.799723:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636902.799723:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636902.799724:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636902.799725:0:18707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788636902.799757:0:18707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788636902.799777:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084352:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788636902.799878:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636902.799913:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033300 going to sleep for 11 seconds 00000100:00100000:0.0:1788636902.800219:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226084352 00000100:00100000:0.0:1788636902.800229:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226084352 00000100:00100000:0.0:1788636902.800296:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788636902.800307:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:18707:x1875521226084352:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788636902.800338:0:17199:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788636902.800341:0:17199:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788636902.800346:0:17199:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788636902.801120:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:18707:x1875521226084352:12345-0@lo:253:mount.lustre.0 Request processed in 812us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636902.801130:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788636902.801265:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084352:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788636902.801276:0:18707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788636902.801279:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788636902.801281:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788636902.801282:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636902.801283:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636902.801284:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636902.801286:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636902.801287:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636902.801288:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636902.801290:0:18707:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788636902.801315:0:18707:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf00324b000 from lustre-OST0000 10000000:01000000:3.0:1788636902.801347:0:18707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788636902.801351:0:18707:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788636902.801359:0:18707:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf040bc19c0 local copy 00010000:00010000:3.0:1788636902.801525:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636902.801722:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636902.801758:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636902.801881:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00817f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788636902.807701:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226084480 00000100:00100000:1.0:1788636902.807721:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226084480 00000100:00100000:1.0:1788636902.809525:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788636902.809552:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+18:18707:x1875521226084480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636902.809719:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+18:18707:x1875521226084480:12345-0@lo:501:mount.lustre.0 Request processed in 179us (7959us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788636902.809729:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788636902.811232:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084480:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788636902.811260:0:18707:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788636902.811301:0:18707:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788636902.811311:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.811335:0:18707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636902.811385:0:18707:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf00324b000 10000000:01000000:2.0:1788636902.811391:0:18707:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788636902.811397:0:18707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788636902.811400:0:18707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788636902.811404:0:18707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788636902.811407:0:18707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788636902.811441:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0e00/0x5b741ef42e839572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.811449:0:18707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0e00/0x5b741ef42e839572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.811459:0:18707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0e00/0x5b741ef42e839572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636902.811490:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084608:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636902.811541:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636902.811731:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226084608 00000100:00100000:0.0:1788636902.811738:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226084608 00000100:00100000:0.0:1788636902.811794:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788636902.811802:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+18:18707:x1875521226084608:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636902.811841:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636902.811854:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6800/0x5b741ef42e839579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e839572 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636902.811877:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6800/0x5b741ef42e839579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e839572 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636902.811888:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6800/0x5b741ef42e839579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e839572 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636902.811896:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6800, rc 0) 00000100:00100000:0.0:1788636902.811930:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+19:18707:x1875521226084608:12345-0@lo:101:mount.lustre.0 Request processed in 129us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636902.811938:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788636902.812074:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636902.812091:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636902.812105:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0e00/0x5b741ef42e839572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839579 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.812115:0:18707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0e00/0x5b741ef42e839572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839579 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788636902.813919:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788636902.818672:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636902.826068:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788636902.826131:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788636902.826148:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788636902.826163:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788636902.826190:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788636902.826505:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788636902.826533:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788636902.826540:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788636902.826666:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636902.826737:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636902.826787:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040900840 going to sleep for 11 seconds 00000100:00100000:1.0:1788636902.827080:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226084736 00000100:00100000:1.0:1788636902.827088:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226084736 00000100:00100000:1.0:1788636902.827141:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788636902.827151:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+19:18707:x1875521226084736:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636902.827313:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+19:18707:x1875521226084736:12345-0@lo:501:mount.lustre.0 Request processed in 163us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.827321:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788636902.827412:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636902.827448:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636902.827505:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636902.827535:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788636902.827588:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226084864 00000100:00100000:3.0:1788636902.827600:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226084864 00000100:00100000:3.0:1788636902.827634:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788636902.827641:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+19:18707:x1875521226084864:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636902.828461:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+19:18707:x1875521226084864:12345-0@lo:503:mount.lustre.0 Request processed in 817us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636902.828471:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788636902.828703:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084864:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788636902.829125:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636902.829196:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636902.829243:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636902.829272:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636902.829335:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226084992 00000100:00100000:3.0:1788636902.829341:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226084992 00000100:00100000:3.0:1788636902.829378:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788636902.829388:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+19:18707:x1875521226084992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636902.829896:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+19:18707:x1875521226084992:12345-0@lo:502:mount.lustre.0 Request processed in 508us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636902.829905:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788636902.830124:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226084992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636902.830350:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788636902.830527:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788636902.830547:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788636902.830560:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788636902.830601:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788636902.830618:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788636902.830632:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788636902.830645:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788636902.830656:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788636902.830667:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788636902.830679:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788636902.830690:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788636902.830718:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636902.830765:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636902.830967:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226085120 00000100:00100000:1.0:1788636902.830973:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226085120 00000100:00100000:1.0:1788636902.831018:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788636902.831027:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+19:18707:x1875521226085120:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636902.831123:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+19:18707:x1875521226085120:12345-0@lo:502:mount.lustre.0 Request processed in 97us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.831130:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788636902.832741:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636902.832777:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636902.832928:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788636902.832941:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788636902.834056:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788636902.834069:0:18724:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788636902.834075:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636902.834077:0:18724:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788636902.834084:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636902.834099:0:18724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cf0339db380) 00000020:00000080:1.0:1788636902.834122:0:18724:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788636902.834128:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788636902.834350:0:18724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf00324b000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788636902.834361:0:18724:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788636902.834435:0:18724:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5b741ef42e839587 00010000:00010000:1.0:1788636902.846558:0:18724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788636902.848753:0:18724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788636902.852683:0:18724:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788636902.854553:0:18724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788636902.854569:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636902.854642:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636902.854645:0:18724:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788636902.854650:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788636902.854652:0:18724:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788636902.854654:0:18724:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636902.854656:0:18724:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636902.854657:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788636902.854660:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636902.854661:0:18724:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788636902.854664:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636902.854666:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636902.854668:0:18724:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788636902.854671:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788636902.854673:0:18724:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788636902.854676:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636902.854678:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636902.854680:0:18724:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788636902.854682:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636902.854684:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636902.854696:0:18724:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788636902.854701:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788636902.858982:0:18724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636902.858998:0:18724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636902.859001:0:18724:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788636902.859008:0:18724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788636902.859220:0:18707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788636902.859255:0:18707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788636902.859285:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0e00/0x5b741ef42e839572 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839579 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.859296:0:18707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03aab0e00/0x5b741ef42e839572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839579 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636902.859305:0:18707:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00324b000 from 1 10000000:01000000:3.0:1788636902.859308:0:18707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636902.859348:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.859381:0:18707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.859393:0:18707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636902.859420:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788636902.859524:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636902.859564:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636902.863541:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226085248 00000100:00100000:1.0:1788636902.863555:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226085248 00000100:00100000:1.0:1788636902.863632:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788636902.863643:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+19:18707:x1875521226085248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636902.863661:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636902.863683:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab36400/0x5b741ef42e839595 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83958e expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636902.863713:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab36400/0x5b741ef42e839595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83958e expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636902.863738:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab36400/0x5b741ef42e839595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83958e expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636902.863747:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36400, rc 0) 00000100:00100000:1.0:1788636902.863844:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+20:18707:x1875521226085248:12345-0@lo:101:mount.lustre.0 Request processed in 202us (4320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.863851:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788636902.864343:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636902.864364:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.864451:0:18707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636902.868014:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788636902.868781:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636902.868988:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788636902.869010:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788636902.869023:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788636902.869028:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788636902.869099:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636902.869160:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636902.869557:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226085376 00000100:00100000:1.0:1788636902.869566:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226085376 00000100:00100000:1.0:1788636902.869621:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788636902.869630:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+20:18707:x1875521226085376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636902.869741:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+20:18707:x1875521226085376:12345-0@lo:501:mount.lustre.0 Request processed in 111us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.869759:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788636902.869977:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788636902.869999:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636902.870031:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636902.870070:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636902.870093:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788636902.870136:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226085504 00000100:00100000:2.0:1788636902.870140:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226085504 00000100:00100000:2.0:1788636902.870168:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788636902.870174:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+20:18707:x1875521226085504:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636902.870272:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+20:18707:x1875521226085504:12345-0@lo:503:mount.lustre.0 Request processed in 97us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636902.870279:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788636902.870485:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085504:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788636902.870917:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788636902.870975:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085632:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636902.871016:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636902.871031:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636902.871232:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226085632 00000100:00100000:1.0:1788636902.871236:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226085632 00000100:00100000:1.0:1788636902.871274:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636902.871283:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+20:18707:x1875521226085632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636902.871379:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+20:18707:x1875521226085632:12345-0@lo:502:mount.lustre.0 Request processed in 87us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.871387:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788636902.871911:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085632:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636902.872086:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788636902.872117:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788636902.872131:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788636902.872142:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788636902.872153:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788636902.872163:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788636902.872173:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788636902.872184:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788636902.872211:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788636902.872228:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788636902.872240:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788636902.872263:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636902.872306:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636902.872333:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636902.872632:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226085760 00000100:00100000:1.0:1788636902.872639:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226085760 00000100:00100000:1.0:1788636902.872674:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788636902.872682:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+20:18707:x1875521226085760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636902.872793:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+20:18707:x1875521226085760:12345-0@lo:502:mount.lustre.0 Request processed in 111us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.872800:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788636902.873034:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636902.873086:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788636902.873096:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788636902.874328:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636902.874339:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636902.874351:0:18728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788636902.874358:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf00324b000 00000020:00000080:3.0:1788636902.874361:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636902.874381:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636902.874384:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636902.874386:0:18728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788636902.874389:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636902.874392:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636902.874393:0:18728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788636902.874396:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf00324b000 00000020:00000080:3.0:1788636902.874398:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636902.878801:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636902.879080:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636902.879083:0:18728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788636902.879089:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636902.879094:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636902.879096:0:18728:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788636902.879100:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf00324b000 00000020:00000080:3.0:1788636902.879103:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636902.879147:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636902.879150:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636902.879152:0:18728:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788636902.879154:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636902.879156:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636902.879158:0:18728:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788636902.879160:0:18728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf00324b000 00000020:00000080:3.0:1788636902.879162:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636902.879212:0:18728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636902.879216:0:18728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636902.879217:0:18728:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788636902.879220:0:18728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788636902.883295:0:18707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788636902.883343:0:18707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636902.883435:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.883449:0:18707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636902.883520:0:18707:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788636902.883524:0:18707:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf00324b000 10000000:01000000:2.0:1788636902.883527:0:18707:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf00324b000 10000000:01000000:2.0:1788636902.883531:0:18707:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788636902.883537:0:18707:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf00324b000 from 1 10000000:01000000:2.0:1788636902.883540:0:18707:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788636902.883650:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1800/0x5b741ef42e83959c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.883660:0:18707:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1800/0x5b741ef42e83959c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.883671:0:18707:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1800/0x5b741ef42e83959c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636902.883706:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085888:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636902.883875:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636902.883914:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033300 going to sleep for 11 seconds 00000100:00100000:3.0:1788636902.885700:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226085888 00000100:00100000:3.0:1788636902.885713:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226085888 00000100:00100000:3.0:1788636902.885882:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788636902.885899:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+20:18707:x1875521226085888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636902.885917:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636902.885933:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8395a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83959c expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.885958:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8395a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83959c expref: 21 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.885969:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0061f8600/0x5b741ef42e8395a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83959c expref: 21 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.885978:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8600, rc 0) 00000100:00100000:3.0:1788636902.886035:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226085888:12345-0@lo:101:mount.lustre.0 Request processed in 138us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636902.886042:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788636902.886798:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226085888:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636902.886847:0:18707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1800/0x5b741ef42e83959c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8395a3 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.886857:0:18707:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1800/0x5b741ef42e83959c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8395a3 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788636902.895697:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788636902.897003:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636902.897224:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788636902.897252:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788636902.897267:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788636902.897278:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788636902.897291:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788636902.897305:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788636902.897333:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788636902.897348:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788636902.897358:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788636902.899435:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788636902.899509:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788636902.899525:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788636902.899536:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788636902.899547:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788636902.899558:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788636902.899569:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788636902.901885:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788636902.901927:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788636902.901943:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788636902.901958:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788636902.901971:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788636902.901984:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788636902.902015:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788636902.902031:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788636902.902045:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788636902.902059:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788636902.902071:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788636902.902083:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788636902.902093:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788636902.902103:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788636902.902115:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788636902.902129:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788636902.902142:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788636902.902155:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788636902.902169:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788636902.902180:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788636902.902202:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788636902.902231:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788636902.902237:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788636902.902345:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226086016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636902.902411:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636902.903587:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226086016 00000100:00100000:0.0:1788636902.903598:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226086016 00000100:00100000:0.0:1788636902.903672:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788636902.903683:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226086016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636902.911774:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226086016:12345-0@lo:501:mount.lustre.0 Request processed in 8082us (9352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636902.911789:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788636902.917735:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aac29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636902.917774:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226086016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636902.917851:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226086144:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636902.917920:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636902.917949:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf03aac29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636902.918049:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226086144 00000100:00100000:1.0:1788636902.918055:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226086144 00000100:00100000:1.0:1788636902.918100:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788636902.918108:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226086144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636902.918230:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226086144:12345-0@lo:503:mount.lustre.0 Request processed in 121us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.918237:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788636902.918535:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226086144:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788636902.919022:0:18707:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636902.919088:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226086272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636902.919120:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636902.919144:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0182e9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788636902.920339:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226086272 00000100:00100000:1.0:1788636902.920350:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226086272 00000100:00100000:1.0:1788636902.920412:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788636902.920421:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226086272:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636902.920589:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226086272:12345-0@lo:502:mount.lustre.0 Request processed in 157us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.920597:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788636902.921894:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226086272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636902.922095:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788636902.922119:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788636902.922126:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788636902.922133:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788636902.922140:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788636902.922147:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788636902.922153:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788636902.922159:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788636902.922166:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788636902.922172:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788636902.922179:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788636902.922185:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788636902.922204:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788636902.922213:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788636902.922234:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788636902.922248:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788636902.922260:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788636902.922273:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788636902.922284:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788636902.922296:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788636902.922308:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788636902.922321:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788636902.922333:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788636902.922345:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788636902.922357:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788636902.924310:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788636902.924330:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788636902.924340:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788636902.924350:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788636902.924361:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788636902.924396:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788636902.924409:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788636902.924419:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788636902.924430:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788636902.924440:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788636902.924450:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788636902.924461:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788636902.924471:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788636902.924493:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788636902.924504:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788636902.924514:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788636902.924524:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788636902.924534:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788636902.924545:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788636902.924555:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788636902.924565:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788636902.924861:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788636902.924877:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788636902.924930:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226086400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636902.924999:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636902.926715:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02033300 going to sleep for 11 seconds 00000100:00100000:1.0:1788636902.933710:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226086400 00000100:00100000:1.0:1788636902.933799:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226086400 00000100:00100000:1.0:1788636902.935824:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788636902.935838:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226086400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636902.936010:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226086400:12345-0@lo:502:mount.lustre.0 Request processed in 175us (11010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.936018:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788636902.938572:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226086400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636902.938859:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788636902.938889:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788636902.938926:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226086528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636902.939005:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636902.939051:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0182e9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788636902.941008:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226086528 00000100:00100000:1.0:1788636902.941023:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226086528 00000100:00100000:1.0:1788636902.941083:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788636902.941093:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226086528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636902.941257:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226086528:12345-0@lo:502:mount.lustre.0 Request processed in 165us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.941264:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788636902.942658:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226086528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636902.942759:0:18707:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788636902.942772:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788636902.947460:0:18733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788636902.947492:0:18733:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cf032408000) 00000020:00000080:3.0:1788636902.947521:0:18733:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788636902.947622:0:18733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf00324b000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788636902.947626:0:18733:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf00324b000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788636902.947629:0:18733:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00324b000 3 00010000:00080000:3.0:1788636902.947660:0:18733:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef033a6800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.126@tcp at head 00010000:00010000:3.0:1788636902.951421:0:18733:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788636902.951658:0:18733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788636902.951710:0:18733:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788636902.951728:0:18733:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5b741ef42e8395b1 00000100:00080000:3.0:1788636902.951740:0:18733:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636902.951747:0:18733:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cef033a6800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636902.951791:0:18733:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcace00 x1875521226086656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788636902.951876:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226086656:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788636902.951950:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636902.952017:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226086656 00000100:00100000:3.0:1788636902.952023:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226086656 00000100:00100000:3.0:1788636902.952053:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636902.952061:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875521226086656:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788636902.952085:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:3.0:1788636902.952113:0:17205:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5b741ef42e8395b8 00000004:00100000:3.0:1788636902.952128:0:17205:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788636902.952168:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9cef026e2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636902.952217:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875521226086656:12345-0@lo:38:llog_process_th.0 Request processed in 155us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636902.952225:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788636902.952263:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf03fcace00 x1875521226086656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636902.952274:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788636902.952281:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788636902.952288:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788636902.952292:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788636902.952294:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef033a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788636902.952299:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3645:1875521226086656:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788636902.952316:0:18733:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788636902.961406:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636902.961413:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636902.961416:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636902.961420:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636902.961448:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636902.961451:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636902.961454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636902.961457:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788636902.961531:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226086784:0@lo:400:kworker.0 00000100:00100000:0.0:1788636902.961604:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636902.961655:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636902.961662:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226086912:0@lo:400:kworker.0 00000100:00100000:0.0:1788636902.961689:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636902.961726:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226087040:0@lo:400:kworker.0 00000100:00100000:0.0:1788636902.961751:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636902.961768:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636902.961774:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226087168:0@lo:400:kworker.0 00000100:00100000:0.0:1788636902.961796:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636902.961979:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226086784 00000100:00100000:0.0:1788636902.961988:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226086784 00000100:00100000:0.0:1788636902.962044:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226087040 00000100:00100000:0.0:1788636902.962048:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226087040 00000100:00100000:0.0:1788636902.962065:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636902.962074:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226086784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636902.962128:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226086784:12345-0@lo:400:kworker.0 Request processed in 55us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636902.962135:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636902.962155:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788636902.962161:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226087040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636902.962193:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226087040:12345-0@lo:400:kworker.0 Request processed in 32us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636902.962199:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788636902.962219:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226086912 00000100:00100000:0.0:1788636902.962222:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226086912 00000100:00100000:0.0:1788636902.962244:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226087168 00000100:00100000:0.0:1788636902.962247:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226087168 00000100:00100000:0.0:1788636902.962259:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788636902.962264:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226086912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636902.962303:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226086912:12345-0@lo:400:kworker.0 Request processed in 38us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636902.962310:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788636902.962323:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788636902.962329:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226087168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636902.962356:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226087168:12345-0@lo:400:kworker.0 Request processed in 28us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636902.962362:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788636902.962403:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cef0237f800 x1875521226086912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636902.962417:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226086912:0@lo:400:kworker.0 00000100:00100000:0.0:1788636902.962430:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226086784:0@lo:400:kworker.0 00010000:00080000:0.0:1788636902.962458:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf01291a680 x1875521226087168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636902.962466:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226087168:0@lo:400:kworker.0 00000100:00100000:0.0:1788636902.962490:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226087040:0@lo:400:kworker.0 00000020:01000004:3.0:1788636902.965921:0:18733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788636902.965939:0:18733:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9cf0324099c0) 00000020:00000080:3.0:1788636902.965979:0:18733:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788636902.966086:0:18733:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf00324b000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788636902.966091:0:18733:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf00324b000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788636902.966094:0:18733:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf00324b000 3 00010000:00080000:3.0:1788636902.966126:0:18733:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef026e3800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.126@tcp at head 00010000:00010000:3.0:1788636902.971969:0:18733:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788636902.972165:0:18733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788636902.972211:0:18733:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788636902.972224:0:18733:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5b741ef42e8395c6 00000100:00080000:3.0:1788636902.972235:0:18733:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636902.972241:0:18733:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9cef026e3800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636902.972280:0:18733:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf03fcace00 x1875521226087296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636902.972312:0:18733:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788636902.975761:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875521226087296:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788636902.975851:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636902.975919:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226087296 00000100:00100000:1.0:1788636902.975926:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226087296 00000100:00100000:1.0:1788636902.975963:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636902.975970:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1875521226087296:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788636902.975998:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 571 last 0 00000020:00000080:1.0:1788636902.976034:0:17206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5b741ef42e8395cd 00000004:00100000:1.0:1788636902.976056:0:17206:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788636902.976087:0:17206:0:(import.c:65:import_set_state_nolock()) ffff9cef02400800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636902.976139:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875521226087296:12345-0@lo:38:llog_process_th.0 Request processed in 168us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636902.976147:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788636902.976188:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf03fcace00 x1875521226087296/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636902.976199:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636902.976206:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788636902.976213:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788636902.976217:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788636902.976219:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef026e3800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788636902.976225:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3645:1875521226087296:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788636902.976602:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636902.976607:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636902.976610:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636902.976612:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636902.976616:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636902.976618:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636902.976628:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636902.976631:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788636902.979642:0:18733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788636902.980525:0:18707:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788636902.980559:0:18707:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788636902.980618:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1800/0x5b741ef42e83959c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8395a3 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.980631:0:18707:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1800/0x5b741ef42e83959c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8395a3 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788636902.980683:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788636902.980685:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788636902.980687:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636902.980688:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636902.980689:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636902.980691:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636902.980692:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636902.980694:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636902.980695:0:18707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636902.980699:0:18707:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788636902.980701:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788636902.980702:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788636902.980704:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636902.980705:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636902.980706:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636902.980707:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636902.980708:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636902.980709:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636902.980710:0:18707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636902.980738:0:18707:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788636902.980757:0:18707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226087424:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788636902.980865:0:18707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636902.980905:0:18707:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636902.981127:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226087424 00000100:00100000:1.0:1788636902.981134:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226087424 00000100:00100000:1.0:1788636902.981187:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788636902.981207:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226087424:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788636902.981236:0:17198:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788636902.981251:0:17198:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788636902.991699:0:17198:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788636902.991755:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788636902.992069:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:18707:x1875521226087424:12345-0@lo:253:mount.lustre.0 Request processed in 10859us (11198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636902.992081:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788636902.992206:0:18707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:18707:1875521226087424:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788636902.992220:0:18707:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788636902.992223:0:18707:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788636902.992225:0:18707:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788636902.992226:0:18707:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636902.992227:0:18707:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636902.992228:0:18707:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636902.992230:0:18707:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636902.992231:0:18707:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788636902.992233:0:18707:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636902.992235:0:18707:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788636902.992253:0:18707:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788636902.997986:0:17220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788636902.997993:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788636902.998016:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.998035:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e83951e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e839517 expref: 20 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.998043:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e83952c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e839525 expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.998050:0:17220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.998093:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e83952c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e839525 expref: 20 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.998109:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e83952c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e839525 expref: 20 pid: 17198 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636902.998125:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226087552:0@lo:104: 00000100:00100000:2.0:1788636902.998201:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788636902.998260:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e83951e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e839517 expref: 20 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636902.998269:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e83951e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e839517 expref: 20 pid: 17196 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636902.998278:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226087680:0@lo:104: 00000100:00100000:3.0:1788636902.998490:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226087552 00000100:00100000:3.0:1788636902.998500:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226087552 00000100:00100000:3.0:1788636902.998543:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788636902.998552:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:17220:x1875521226087552:12345-0@lo:104: 00010000:00010000:3.0:1788636902.998566:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.998626:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636902.998633:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:17220:x1875521226087552:12345-0@lo:104: Request processed in 82us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636902.998646:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788636902.998674:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636902.998681:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.998688:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:3.0:1788636902.998692:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.998700:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636902.998708:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636902.998713:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636902.998742:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.998749:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636902.998766:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.998773:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0061f8800/0x5b741ef42e839525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83952c expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636902.998786:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636902.998787:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636902.998789:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636902.998970:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636902.998999:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0081fb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788636902.999022:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226087552:0@lo:104: 00000100:00100000:0.0:1788636902.999099:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226087808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636902.999146:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636902.999918:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226087808 00000100:00100000:2.0:1788636902.999925:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226087808 00010000:00010000:2.0:1788636902.999952:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e83952c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e839525 expref: 21 pid: 17198 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636902.999978:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636902.999985:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7a34533-966f-4857-8403-9471b802ebf2+21:3646:x1875521226087808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636902.999996:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636903.000001:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e83952c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e839525 expref: 21 pid: 17198 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.000012:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e83952c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e839525 expref: 21 pid: 17198 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.000025:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c6e00/0x5b741ef42e83952c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e839525 expref: 21 pid: 17198 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.000039:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636903.000084:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7a34533-966f-4857-8403-9471b802ebf2+20:3646:x1875521226087808:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636903.000091:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636903.000122:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226087808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636903.000280:0:17187:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788636903.000301:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226087680 00000100:00100000:3.0:1788636903.000305:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226087680 00000100:00100000:3.0:1788636903.000339:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636903.000345:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03af99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:17220:x1875521226087680:12345-0@lo:104: 00010000:00010000:3.0:1788636903.000355:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636903.000570:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636903.000583:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03af99c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:17220:x1875521226087680:12345-0@lo:104: Request processed in 239us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636903.000590:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788636903.000962:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636903.000969:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.000989:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:2.0:1788636903.000992:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001001:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636903.001008:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636903.001014:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636903.001048:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001055:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636903.001074:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001081:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9600/0x5b741ef42e839517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e83951e expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001097:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636903.001099:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636903.001101:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636903.001114:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226087936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636903.001153:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636903.001211:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226087936 00000100:00100000:2.0:1788636903.001216:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226087936 00010000:00010000:2.0:1788636903.001233:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e83951e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e839517 expref: 20 pid: 17196 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636903.001263:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636903.001271:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03238bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7a34533-966f-4857-8403-9471b802ebf2+20:3647:x1875521226087936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636903.001280:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636903.001285:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e83951e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e839517 expref: 20 pid: 17196 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001295:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e83951e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e839517 expref: 20 pid: 17196 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001309:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001317:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788636903.001331:0:17191:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012614678s 00010000:00010000:2.0:1788636903.001335:0:17191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001342:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001349:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001355:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001360:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636903.001449:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001458:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001467:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636903.001488:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636903.001524:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03238bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7a34533-966f-4857-8403-9471b802ebf2+20:3647:x1875521226087936:12345-0@lo:103:ldlm_bl.0 Request processed in 254us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636903.001531:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636903.001658:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226087936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636903.002528:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e83951e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e839517 expref: 19 pid: 17196 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636903.002541:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226087680:0@lo:104: 00010000:00010000:0.0:1788636903.002558:0:17220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636903.002567:0:17220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636903.002573:0:17220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636903.002657:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8395d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788636903.004736:0:18707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788636903.007919:0:18707:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788636903.007929:0:18707:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788636903.007963:0:18707:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788636903.008017:0:18707:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788636903.008037:0:18707:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788636903.008056:0:18707:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788636903.010045:0:18707:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636903.013741:0:18707:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788636903.574058:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788636903.835117:0:18787:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788636903.835715:0:18787:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788636904.213327:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788636904.213336:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf0113d7000 from 9 10000000:01000000:1.0:1788636904.213341:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788636904.213397:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636904.213411:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636904.213444:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636904.213486:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226088064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636904.213572:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636904.213620:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636904.213683:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226088064 00000100:00100000:2.0:1788636904.213692:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226088064 00000100:00100000:2.0:1788636904.213757:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788636904.213766:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+19:17201:x1875521226088064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636904.213779:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636904.213794:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e8395e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8395db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636904.213846:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e8395e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8395db expref: 20 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636904.213857:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e8395e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8395db expref: 20 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636904.213866:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1c00, rc 0) 00000100:00100000:2.0:1788636904.213921:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+20:17201:x1875521226088064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636904.213928:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788636904.214647:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226088064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636904.214667:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636904.214676:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636904.214743:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226088192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788636904.214789:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636904.214841:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0061f3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636904.214951:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226088192 00000100:00100000:3.0:1788636904.214958:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226088192 00000100:00100000:3.0:1788636904.215003:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788636904.215011:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+20:17201:x1875521226088192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788636904.215029:0:17198:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788636904.215058:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788636904.215062:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788636904.215153:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+20:17201:x1875521226088192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636904.215169:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788636904.215336:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226088192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788636904.215398:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788636904.215407:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636904.215416:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636904.215427:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788636904.215429:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cef03105000 from 9 10000000:01000000:0.0:1788636904.215432:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788636904.215453:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636904.215462:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636904.215489:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636904.215505:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226088320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636904.215533:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636904.215562:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788636904.216168:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226088320 00000100:00100000:1.0:1788636904.216175:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226088320 00000100:00100000:1.0:1788636904.216218:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788636904.216226:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+20:17201:x1875521226088320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636904.216236:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636904.216249:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e8395f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8395e9 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636904.216270:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e8395f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8395e9 expref: 21 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636904.216280:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e8395f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8395e9 expref: 21 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636904.216288:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37600, rc 0) 00000100:00100000:1.0:1788636904.216332:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+21:17201:x1875521226088320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636904.216338:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788636904.218100:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226088320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636904.218127:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636904.218139:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636904.218220:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226088448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788636904.218274:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636904.218569:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026b6f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788636904.220446:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226088448 00000100:00100000:1.0:1788636904.220465:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226088448 00000100:00100000:1.0:1788636904.220563:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788636904.220576:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+21:17201:x1875521226088448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788636904.220628:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788636904.220647:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788636904.220650:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788636904.220838:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+21:17201:x1875521226088448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 264us (2562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636904.220846:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788636904.222162:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226088448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788636904.222255:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788636904.222267:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636904.222277:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636904.597209:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636905.108983:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636905.109010:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226088576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636905.109090:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636905.109145:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226088576 00000100:00100000:3.0:1788636905.109153:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226088576 00000100:00100000:3.0:1788636905.109205:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788636905.109213:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226088576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788636905.109266:0:17946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788636905.109317:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226088576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636905.109325:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788636905.109367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226088576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636905.109873:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636905.111471:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226088704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636905.111550:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636905.112152:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226088704 00000100:00100000:1.0:1788636905.112161:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226088704 00000100:00100000:1.0:1788636905.112201:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788636905.112211:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226088704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636905.112428:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788636905.112504:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226088704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 294us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636905.112512:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788636905.112668:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226088704:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788636905.621529:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788636906.225009:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788636906.647761:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636907.719412:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788636908.184202:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636908.184209:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636908.184213:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636908.184216:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636908.184245:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636908.184248:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636908.184251:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636908.184254:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788636908.184296:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226088960:0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.184368:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636908.184413:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521226089472:0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.184434:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636908.184459:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788636908.184465:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226088832:0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.184504:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636908.184524:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226089344:0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.184546:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636908.184570:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521226089088:0@lo:400:kworker.0 00000100:00100000:1.0:1788636908.184699:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226088832 00000100:00100000:1.0:1788636908.184707:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226088832 00000100:00100000:1.0:1788636908.184756:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788636908.184766:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+21:3647:x1875521226088832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636908.184838:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+21:3647:x1875521226088832:12345-0@lo:400:kworker.0 Request processed in 74us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636908.184846:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788636908.184879:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226089472 00000100:00100000:1.0:1788636908.184882:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226089472 00000100:00100000:1.0:1788636908.184917:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226089344 00000100:00100000:1.0:1788636908.184920:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226089344 00000100:00100000:1.0:1788636908.184933:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788636908.184939:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521226089472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636908.184979:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521226089472:12345-0@lo:400:kworker.0 Request processed in 40us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636908.184986:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788636908.184998:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788636908.185004:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226089344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636908.185027:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226089344:12345-0@lo:400:kworker.0 Request processed in 23us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636908.185032:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788636908.185068:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226088832:0@lo:400:kworker.0 00010000:00080000:1.0:1788636908.185080:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03fcace00 x1875521226089344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636908.185091:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226089344:0@lo:400:kworker.0 00010000:00080000:1.0:1788636908.185103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0362c380 x1875521226089472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636908.185110:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521226089472:0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.185185:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636908.185208:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226089600:0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.185236:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636908.185255:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636908.185260:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226089216:0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.185282:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636908.185313:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226088960 00000100:00100000:3.0:1788636908.185317:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226088960 00000100:00100000:3.0:1788636908.185342:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226089216 00000100:00100000:3.0:1788636908.185345:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226089216 00000100:00100000:3.0:1788636908.185357:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636908.185362:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226088960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.185395:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226088960:12345-0@lo:400:kworker.0 Request processed in 33us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636908.185401:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636908.185411:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636908.185416:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226089216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.185451:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226089216:12345-0@lo:400:kworker.0 Request processed in 34us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636908.185457:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636908.185472:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226089088 00000100:00100000:3.0:1788636908.185475:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226089088 00000100:00100000:3.0:1788636908.185500:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226089600 00000100:00100000:3.0:1788636908.185502:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226089600 00000100:00100000:3.0:1788636908.185515:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636908.185521:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521226089088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.185545:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521226089088:12345-0@lo:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636908.185551:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636908.185559:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788636908.185564:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226089600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.185585:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226089600:12345-0@lo:400:kworker.0 Request processed in 21us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636908.185707:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226088960:0@lo:400:kworker.0 00000100:00100000:3.0:1788636908.185754:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788636908.185782:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636908.185786:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636908.185844:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226089216:0@lo:400:kworker.0 00010000:00080000:3.0:1788636908.185855:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03fcad180 x1875521226089088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636908.185864:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521226089088:0@lo:400:kworker.0 00010000:00080000:3.0:1788636908.185871:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0362c700 x1875521226089600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636908.185878:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226089600:0@lo:400:kworker.0 00010000:00010000:3.0:1788636908.758069:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636909.144696:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636894/real 1788636894] req@ffff9cf03fcad880 x1875521226082432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636909 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636909.144740:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf03fcad880 x1875521226082432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636909 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636909.144750:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636894/real 1788636894] req@ffff9cf03fcafb80 x1875521226082560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636909 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636909.144761:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf03fcafb80 x1875521226082560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636909 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788636909.144780:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf01135c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636909.144797:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788636909.144801:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226082432:0@lo:8:kworker.0 00000100:00080000:0.0:1788636909.144954:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636909.144961:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788636909.144965:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226082560:0@lo:8:kworker.0 00000100:00080000:0.0:1788636909.145055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636909.145060:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636909.145063:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636909.145065:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636909.145080:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636909.145083:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788636909.145085:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cf01135c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636909.145089:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 563 00000100:00080000:0.0:1788636909.145094:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788636909.145107:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9cf01135c800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636909.145129:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef019b1f80 x1875521226090240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636909.145141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636909.145145:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788636909.145146:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636909.145149:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 563 00000100:00080000:0.0:1788636909.145151:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788636909.145154:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cf032136000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:0.0:1788636909.145164:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef019b2a00 x1875521226090368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636909.145206:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7a34533-966f-4857-8403-9471b802ebf2:3649:1875521226089728:0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.145269:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.145304:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226090496:0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.145330:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.145353:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636909.145359:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226090112:0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.145385:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.145415:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226089856:0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.145438:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.145456:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226090624:0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.145480:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.145512:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788636909.145518:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226089984:0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.145549:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.145567:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226090752:0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.145589:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.145615:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226089728 00000100:00100000:0.0:1788636909.145623:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226089728 00000100:00100000:0.0:1788636909.145667:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788636909.145677:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:3649:x1875521226089728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.145719:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:3649:x1875521226089728:12345-0@lo:400:kworker.0 Request processed in 44us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636909.145726:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788636909.145757:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226090496 00000100:00100000:0.0:1788636909.145760:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226090496 00000100:00100000:0.0:1788636909.145778:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226090624 00000100:00100000:0.0:1788636909.145780:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226090624 00000100:00100000:0.0:1788636909.145791:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226089984 00000100:00100000:0.0:1788636909.145793:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226089984 00000100:00100000:0.0:1788636909.145803:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226090752 00000100:00100000:0.0:1788636909.145833:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226090752 00000100:00100000:0.0:1788636909.145849:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636909.145854:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226090496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.145887:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226090496:12345-0@lo:400:kworker.0 Request processed in 32us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636909.145893:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636909.145906:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636909.145912:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226090624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.145943:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226090624:12345-0@lo:400:kworker.0 Request processed in 32us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636909.145959:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636909.145972:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636909.145977:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226089984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.146005:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226089984:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636909.146010:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636909.146022:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636909.146028:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226090752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.146054:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226090752:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636909.146059:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636909.146075:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226090112 00000100:00100000:0.0:1788636909.146078:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226090112 00000100:00100000:0.0:1788636909.146097:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226089856 00000100:00100000:0.0:1788636909.146099:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226089856 00000100:00100000:0.0:1788636909.146109:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788636909.146114:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226090112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.146140:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226090112:12345-0@lo:400:kworker.0 Request processed in 26us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636909.146146:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788636909.146156:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788636909.146161:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226089856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636909.146183:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226089856:12345-0@lo:400:kworker.0 Request processed in 22us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636909.146188:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788636909.146227:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226090240:0@lo:8:kworker.0 00000100:00100000:0.0:1788636909.146258:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.146282:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226090368:0@lo:8:kworker.0 00000100:00100000:0.0:1788636909.146325:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.146360:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226090240 00000100:00100000:0.0:1788636909.146364:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226090240 00000100:00100000:0.0:1788636909.146379:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226090368 00000100:00100000:0.0:1788636909.146381:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226090368 00000100:00100000:0.0:1788636909.146389:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636909.146395:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226090240:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788636909.146420:0:18712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:0.0:1788636909.146450:0:18712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e8395f7 00002000:00100000:0.0:1788636909.146464:0:18712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9cef03757800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788636909.146468:0:18712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788636909.146471:0:18712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788636909.146651:0:18712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788636909.146675:0:18712:0:(import.c:65:import_set_state_nolock()) ffff9cef03751000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636909.146713:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3645:x1875521226090240:12345-0@lo:8:kworker.0 Request processed in 317us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636909.146720:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636909.146734:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636909.146738:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226090368:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788636909.146749:0:18712:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788636909.170747:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b0a80 x1875521226089984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636909.170768:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226089984:0@lo:400:kworker.0 00010000:00080000:1.0:1788636909.170784:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b3480 x1875521226090752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636909.170792:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226090752:0@lo:400:kworker.0 00000100:00100000:1.0:1788636909.170846:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226089856:0@lo:400:kworker.0 00010000:00080000:1.0:1788636909.170857:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b3800 x1875521226090624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636909.170866:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226090624:0@lo:400:kworker.0 00000100:00100000:1.0:1788636909.170912:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226090112:0@lo:400:kworker.0 00000100:00100000:1.0:1788636909.170924:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7a34533-966f-4857-8403-9471b802ebf2:3649:1875521226089728:0@lo:400:kworker.0 00010000:00080000:1.0:1788636909.170936:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b0380 x1875521226090496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636909.170945:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226090496:0@lo:400:kworker.0 00010000:00080000:0.0:1788636909.174745:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef019b1f80 x1875521226090240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636909.174761:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788636909.174783:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788636909.174793:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788636909.174800:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00100000:1.0:1788636909.174936:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226090368:12345-0@lo:8:kworker.0 Request processed in 28194us (28608us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788636909.174950:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788636909.175118:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf01135c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788636909.175135:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788636909.175142:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226090240:0@lo:8:kworker.0 00000100:00080000:0.0:1788636909.175160:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788636909.175165:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788636909.175167:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226090368:0@lo:8:kworker.0 00000004:00080000:0.0:1788636909.175239:0:17947:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788636909.175260:0:17947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875521226091008:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788636909.175296:0:17947:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.175320:0:17947:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef023976c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636909.175341:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226091008 00000100:00100000:0.0:1788636909.175347:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226091008 00000100:00100000:0.0:1788636909.175389:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636909.175397:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17947:x1875521226091008:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:0.0:1788636909.175838:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636909.175859:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226090880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636909.175894:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636909.176008:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226090880 00000100:00100000:3.0:1788636909.176012:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226090880 00000100:00100000:3.0:1788636909.176044:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636909.176052:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875521226090880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636909.176071:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788636909.176113:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875521226090880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636909.176120:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788636909.179959:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf01291b100 x1875521226090880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636909.179988:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226090880:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788636909.180914:0:17945:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788636909.180994:0:17945:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 577992186966ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788636909.181009:0:17945:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:0.0:1788636909.181128:0:18713:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788636909.181134:0:18713:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788636909.181221:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17947:x1875521226091008:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5821us (5922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636909.181231:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788636909.181311:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf01291aa00 x1875521226091008/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788636925 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636909.181325:0:17947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875521226091008:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788636909.181340:0:17947:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788636909.181386:0:17947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875521226091136:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788636909.181423:0:17947:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636909.181455:0:17947:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040923180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636909.181792:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226091136 00000100:00100000:0.0:1788636909.181800:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226091136 00000100:00100000:0.0:1788636909.181897:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636909.181905:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17947:x1875521226091136:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788636909.181931:0:18714:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788636909.181969:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17947:x1875521226091136:12345-0@lo:5:osp-pre-0-1.0 Request processed in 64us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636909.181975:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788636909.182140:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0362c700 x1875521226091136/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636925 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636909.182150:0:17947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875521226091136:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788636909.182159:0:17947:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788636909.182190:0:17947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875521226091264:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788636909.182213:0:17947:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636909.182235:0:17947:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040923180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636909.182273:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226091264 00000100:00100000:0.0:1788636909.182278:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226091264 00000100:00100000:0.0:1788636909.182301:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636909.182307:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17947:x1875521226091264:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788636909.182333:0:18713:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:1.0:1788636909.184961:0:17937:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:02000400:2.0:1788636909.189303:0:19076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:0.0:1788636909.218818:0:18708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788636909.218838:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788636909.219011:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17947:x1875521226091264:12345-0@lo:5:osp-pre-0-1.0 Request processed in 36698us (36791us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788636909.219021:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788636909.219076:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0362c700 x1875521226091264/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636925 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636909.219088:0:17947:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788636909.219095:0:17947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17947:1875521226091264:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788636909.219121:0:17947:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788636909.219174:0:17947:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17947:1875521226091392:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788636909.219211:0:17947:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636909.219235:0:17947:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636909.220911:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226091392 00000100:00100000:3.0:1788636909.220928:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226091392 00000100:00100000:3.0:1788636909.221008:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636909.221017:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17947:x1875521226091392:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788636909.221110:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17947:x1875521226091392:12345-0@lo:900:osp-pre-0-1.0 Request processed in 94us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636909.221119:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788636909.223938:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0237d180 x1875521226091392/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788636925 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636909.223959:0:17947:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17947:1875521226091392:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788636909.781259:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788636910.057119:0:19128:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636910.057410:0:19128:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788636910.105681:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788636910.230360:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226091520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636910.230439:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636910.230514:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226091520 00000100:00100000:0.0:1788636910.230523:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226091520 00000100:00100000:0.0:1788636910.230572:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788636910.230582:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226091520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636910.230631:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788636910.230675:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226091520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636910.230682:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788636910.230732:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226091520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788636910.231923:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226091648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636910.231970:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636910.232013:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226091648 00000100:00100000:2.0:1788636910.232018:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226091648 00000100:00100000:2.0:1788636910.232056:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788636910.232065:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226091648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788636910.232091:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788636910.232134:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226091648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636910.232140:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788636910.232171:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226091648:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788636910.805546:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788636910.850577:0:19179:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788636910.850873:0:19179:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788636911.829323:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636912.853900:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636913.236899:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636893/real 1788636893] req@ffff9cef033be300 x1875521226080896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636913 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636913.236948:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cef033be300 x1875521226080896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636913 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636913.236960:0:3645:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636893/real 1788636893] req@ffff9cef033bdf80 x1875521226081024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636913 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636913.236973:0:3645:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cef033bdf80 x1875521226081024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636913 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788636913.236994:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf015a7a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636913.237020:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788636913.237025:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226080896:0@lo:8:kworker.0 00000100:00080000:2.0:1788636913.237034:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636913.237040:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788636913.237043:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226081024:0@lo:8:kworker.0 00000100:00080000:3.0:1788636913.237211:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636913.237215:0:16613:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788636913.237219:0:16613:0:(import.c:65:import_set_state_nolock()) ffff9cf015a7a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636913.237224:0:16613:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 562 00000100:00080000:3.0:1788636913.237229:0:16613:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788636913.237236:0:16613:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf015a7a000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636913.237257:0:16613:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0362f800 x1875521226092032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636913.237278:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636913.237281:0:16613:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788636913.237283:0:16613:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636913.237293:0:16613:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 562 00000100:00080000:3.0:1788636913.237295:0:16613:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788636913.237299:0:16613:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf032424800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636913.237312:0:16613:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0362f100 x1875521226092160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636913.237317:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226092032:0@lo:8:kworker.0 00000100:00080000:3.0:1788636913.237335:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636913.237338:0:16613:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788636913.237340:0:16613:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636913.237343:0:16613:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 577 00000100:00080000:3.0:1788636913.237345:0:16613:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788636913.237348:0:16613:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cf032136000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:3.0:1788636913.237372:0:16613:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef0362ed80 x1875521226092672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636913.237389:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636913.237408:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226091904:0@lo:400:kworker.0 00000100:00100000:1.0:1788636913.237434:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226092160:0@lo:8:kworker.0 00000100:00100000:3.0:1788636913.237437:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636913.237456:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226092800:0@lo:400:kworker.0 00000100:00100000:1.0:1788636913.237456:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636913.237470:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226092672:0@lo:8:kworker.0 00000100:00100000:3.0:1788636913.237476:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636913.237491:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636913.237494:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788636913.237518:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521226092288:0@lo:400:kworker.0 00000100:00100000:1.0:1788636913.237527:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226092032 00000100:00100000:1.0:1788636913.237534:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226092032 00000100:00100000:3.0:1788636913.237540:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636913.237557:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226092928:0@lo:400:kworker.0 00000100:00100000:1.0:1788636913.237559:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226092160 00000100:00100000:1.0:1788636913.237562:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226092160 00000100:00100000:1.0:1788636913.237569:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226092672 00000100:00100000:3.0:1788636913.237576:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636913.237576:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226092672 00000100:00100000:1.0:1788636913.237592:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636913.237598:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226092032:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788636913.237602:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226091904 00000100:00100000:3.0:1788636913.237604:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226091904 00000100:00100000:3.0:1788636913.237633:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788636913.237636:0:18712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 582 last 0 00000100:00100000:3.0:1788636913.237656:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226091904:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1788636913.237662:0:18712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e8395fe 00002000:00100000:1.0:1788636913.237675:0:18712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cef02404000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788636913.237678:0:18712:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788636913.237681:0:18712:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788636913.237702:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226091904:12345-0@lo:400:kworker.0 Request processed in 46us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636913.237708:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788636913.237730:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226092800 00000100:00100000:3.0:1788636913.237733:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226092800 00000100:00100000:3.0:1788636913.237750:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226092288 00000100:00100000:3.0:1788636913.237752:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226092288 00000100:00100000:3.0:1788636913.237762:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226092928 00000100:00100000:3.0:1788636913.237764:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226092928 00002000:00080000:1.0:1788636913.237777:0:18712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1788636913.237788:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636913.237793:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226092800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788636913.237799:0:18712:0:(import.c:65:import_set_state_nolock()) ffff9cef02403800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636913.237844:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226092800:12345-0@lo:400:kworker.0 Request processed in 50us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636913.237850:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875521226092032:12345-0@lo:8:kworker.0 Request processed in 252us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636913.237852:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788636913.237856:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788636913.237863:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788636913.237866:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636913.237869:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521226092288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636913.237870:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226092160:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788636913.237881:0:18712:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788636913.237893:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875521226092288:12345-0@lo:400:kworker.0 Request processed in 25us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636913.237899:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636913.237910:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788636913.237916:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226092928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636913.237940:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226092928:12345-0@lo:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636913.237946:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788636913.237969:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788636913.237990:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0362ea00 x1875521226092288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636913.238009:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875521226092288:0@lo:400:kworker.0 00010000:00080000:3.0:1788636913.238026:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0362c380 x1875521226092928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636913.238033:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226092928:0@lo:400:kworker.0 00000100:00100000:3.0:1788636913.238041:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226091904:0@lo:400:kworker.0 00010000:00080000:3.0:1788636913.238047:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0362c700 x1875521226092800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636913.238054:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226092800:0@lo:400:kworker.0 00000100:00100000:2.0:1788636913.238138:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226091776:0@lo:400:kworker.0 00000100:00100000:2.0:1788636913.238173:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636913.238209:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226092544:0@lo:400:kworker.0 00000100:00100000:2.0:1788636913.238231:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636913.238243:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788636913.238248:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226092416:0@lo:400:kworker.0 00000100:00100000:2.0:1788636913.238269:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636913.238286:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226093056:0@lo:400:kworker.0 00000100:00100000:2.0:1788636913.238310:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636913.238333:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226092416 00000100:00100000:2.0:1788636913.238342:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226092416 00000100:00100000:2.0:1788636913.238365:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788636913.238371:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226092416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636913.238407:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226092416:12345-0@lo:400:kworker.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636913.238414:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788636913.238439:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226092416:0@lo:400:kworker.0 00000100:00100000:1.0:1788636913.238615:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226092160:12345-0@lo:8:kworker.0 Request processed in 733us (1147us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788636913.238624:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788636913.238636:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226092544 00000100:00100000:1.0:1788636913.238640:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226092544 00000100:00100000:1.0:1788636913.238676:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636913.238682:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226092544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636913.238731:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226092544:12345-0@lo:400:kworker.0 Request processed in 48us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636913.238737:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636913.238756:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636913.238760:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226092672:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788636913.238775:0:18712:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788636913.238801:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226092672:12345-0@lo:8:kworker.0 Request processed in 39us (1309us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788636913.238827:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788636913.238859:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0362e680 x1875521226092544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636913.238869:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226092544:0@lo:400:kworker.0 00000100:00080000:1.0:1788636913.239036:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636913.239041:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788636913.239044:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226092160:0@lo:8:kworker.0 00000100:00080000:1.0:1788636913.239052:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636913.239055:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788636913.239057:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226092672:0@lo:8:kworker.0 00010000:00080000:1.0:1788636913.239069:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0362f800 x1875521226092032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636913.239078:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636913.239084:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788636913.239092:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788636913.239096:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788636913.239099:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf015a7a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788636913.239111:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788636913.239116:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226092032:0@lo:8:kworker.0 00000004:00080000:1.0:1788636913.239148:0:17228:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788636913.239300:0:17228:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 582050491732ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788636913.239306:0:17228:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788636913.240162:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226091776 00000100:00100000:3.0:1788636913.240171:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226091776 00000100:00080000:2.0:1788636913.240197:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636913.240212:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788636913.240220:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+21:3647:x1875521226091776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636913.240874:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+21:3647:x1875521226091776:12345-0@lo:400:kworker.0 Request processed in 652us (2696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636913.240882:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788636913.240970:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226093056 00000100:00100000:3.0:1788636913.240975:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226093056 00000100:00100000:3.0:1788636913.241016:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788636913.241023:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226093056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636913.241057:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875521226093056:12345-0@lo:400:kworker.0 Request processed in 35us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636913.241063:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788636913.241126:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788636913.241438:0:17229:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788636913.241462:0:17229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17229:1875521226093312:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788636913.241514:0:17229:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636913.241544:0:17229:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636913.241558:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636913.241569:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226093184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636913.241601:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636913.241641:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226093184 00000100:00100000:0.0:1788636913.241654:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226093184 00010000:00080000:1.0:1788636913.241674:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf03a9d6300 x1875521226093056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636913.241689:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3647:1875521226093056:0@lo:400:kworker.0 00000100:00100000:0.0:1788636913.241695:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636913.241702:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226093184:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636913.241705:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226091776:0@lo:400:kworker.0 00002000:00000024:0.0:1788636913.241722:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788636913.241761:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226093184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636913.241765:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788636913.241779:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636913.241785:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226093312 00000100:00100000:0.0:1788636913.241788:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226093312 00000100:00100000:0.0:1788636913.241803:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636913.241827:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17229:x1875521226093312:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:1.0:1788636913.243621:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef0237f800 x1875521226093184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636913.243647:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226093184:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788636913.244881:0:17184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788636913.246400:0:18712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788636913.246418:0:18712:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788636913.246425:0:18712:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:3.0:1788636913.261455:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.261469:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001daaea5b/0x5b741ef42e839605 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.261488:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.261493:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.261499:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001daaea5b/0x5b741ef42e839605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.261528:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001daaea5b/0x5b741ef42e839605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.261539:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001daaea5b/0x5b741ef42e839605 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.261547:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001daaea5b/0x5b741ef42e839605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.261666:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636913.267986:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.267999:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bfbed8d/0x5b741ef42e83960c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.268016:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.268020:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.268026:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bfbed8d/0x5b741ef42e83960c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.268055:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bfbed8d/0x5b741ef42e83960c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.268065:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bfbed8d/0x5b741ef42e83960c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.268073:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bfbed8d/0x5b741ef42e83960c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.269745:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636913.269756:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001daaea5b/0x5b741ef42e839605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.269768:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.269773:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001daaea5b/0x5b741ef42e839605 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.269784:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001daaea5b/0x5b741ef42e839605 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.269824:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001daaea5b/0x5b741ef42e839605 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.269846:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001daaea5b/0x5b741ef42e839605 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.269870:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.269874:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bfbed8d/0x5b741ef42e83960c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.269880:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.269883:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bfbed8d/0x5b741ef42e83960c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.269891:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bfbed8d/0x5b741ef42e83960c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.269901:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bfbed8d/0x5b741ef42e83960c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.269909:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.269911:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.269913:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636913.273370:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788636913.273389:0:18712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bfbed8d/0x5b741ef42e83960c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.274210:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.275343:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.275354:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3b269/0x5b741ef42e839613 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.275373:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.275377:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.275384:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3b269/0x5b741ef42e839613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.275398:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f3b269/0x5b741ef42e839613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.275425:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f3b269/0x5b741ef42e839613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.275433:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f3b269/0x5b741ef42e839613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.275452:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636913.275463:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636913.275468:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f3b269/0x5b741ef42e839613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.275476:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9e00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636913.275481:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f3b269/0x5b741ef42e839613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.275490:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f3b269/0x5b741ef42e839613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.275519:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f3b269/0x5b741ef42e839613 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.275528:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f3b269/0x5b741ef42e839613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.275547:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636913.275555:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636913.275557:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.279229:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.279243:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026c4bb54/0x5b741ef42e83961a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.279259:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.279263:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.279270:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026c4bb54/0x5b741ef42e83961a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.279283:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026c4bb54/0x5b741ef42e83961a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.279294:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026c4bb54/0x5b741ef42e83961a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.279302:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026c4bb54/0x5b741ef42e83961a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.280735:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636913.281524:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636913.281534:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026c4bb54/0x5b741ef42e83961a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.281547:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636913.281553:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026c4bb54/0x5b741ef42e83961a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.281565:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026c4bb54/0x5b741ef42e83961a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.281589:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026c4bb54/0x5b741ef42e83961a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.281598:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026c4bb54/0x5b741ef42e83961a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.281645:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.281647:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.281649:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.282067:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.282075:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074b6fbd0/0x5b741ef42e839621 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.282160:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.282164:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.282171:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074b6fbd0/0x5b741ef42e839621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.282193:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074b6fbd0/0x5b741ef42e839621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.282202:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074b6fbd0/0x5b741ef42e839621 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.282208:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074b6fbd0/0x5b741ef42e839621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.282233:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.282394:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.282401:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074b6fbd0/0x5b741ef42e839621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.282409:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.282420:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074b6fbd0/0x5b741ef42e839621 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.282428:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074b6fbd0/0x5b741ef42e839621 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.282440:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074b6fbd0/0x5b741ef42e839621 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.282447:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074b6fbd0/0x5b741ef42e839621 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.282461:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.282463:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.282465:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.283242:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.283250:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d7eb626/0x5b741ef42e839628 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.283262:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.283266:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.283271:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d7eb626/0x5b741ef42e839628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.283280:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d7eb626/0x5b741ef42e839628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.283288:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d7eb626/0x5b741ef42e839628 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.283307:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d7eb626/0x5b741ef42e839628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.283372:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636913.287294:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.287309:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8c5740/0x5b741ef42e83962f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.287328:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.287332:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.287339:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b8c5740/0x5b741ef42e83962f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.287353:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b8c5740/0x5b741ef42e83962f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.287362:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8c5740/0x5b741ef42e83962f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.287370:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b8c5740/0x5b741ef42e83962f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.287493:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636913.287511:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d7eb626/0x5b741ef42e839628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.287520:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636913.287524:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d7eb626/0x5b741ef42e839628 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.287534:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d7eb626/0x5b741ef42e839628 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.287552:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d7eb626/0x5b741ef42e839628 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.287561:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d7eb626/0x5b741ef42e839628 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.291271:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636913.291671:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636913.291681:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b8c5740/0x5b741ef42e83962f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.291695:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9200 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636913.291709:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8c5740/0x5b741ef42e83962f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.291721:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8c5740/0x5b741ef42e83962f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.291749:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b8c5740/0x5b741ef42e83962f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.291757:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b8c5740/0x5b741ef42e83962f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.291783:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.291785:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.291787:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.293315:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.293326:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11b75ee/0x5b741ef42e839636 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.293352:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.293357:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.293363:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b11b75ee/0x5b741ef42e839636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.293377:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b11b75ee/0x5b741ef42e839636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.293388:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11b75ee/0x5b741ef42e839636 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.293395:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b11b75ee/0x5b741ef42e839636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.293416:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636913.293872:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636913.293879:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b11b75ee/0x5b741ef42e839636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.293889:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636913.293893:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11b75ee/0x5b741ef42e839636 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.293902:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11b75ee/0x5b741ef42e839636 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.293919:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b11b75ee/0x5b741ef42e839636 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.293935:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b11b75ee/0x5b741ef42e839636 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.293958:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.293960:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.293962:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.294040:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.294043:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.294045:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.295285:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.295296:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028fc7053/0x5b741ef42e83963d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.295311:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.295316:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.295322:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028fc7053/0x5b741ef42e83963d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.295335:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028fc7053/0x5b741ef42e83963d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.295361:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028fc7053/0x5b741ef42e83963d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.295370:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028fc7053/0x5b741ef42e83963d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.295392:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.296411:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.296421:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028fc7053/0x5b741ef42e83963d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.296431:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0013a0200 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.296436:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028fc7053/0x5b741ef42e83963d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.296446:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028fc7053/0x5b741ef42e83963d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.296481:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028fc7053/0x5b741ef42e83963d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.296489:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028fc7053/0x5b741ef42e83963d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.296523:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.296525:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.296527:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.297908:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.297919:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f417ee41/0x5b741ef42e839644 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.297934:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.297938:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.297943:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f417ee41/0x5b741ef42e839644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.297956:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f417ee41/0x5b741ef42e839644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.297965:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f417ee41/0x5b741ef42e839644 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.297973:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f417ee41/0x5b741ef42e839644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.298009:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636913.298872:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636913.298882:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f417ee41/0x5b741ef42e839644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.298893:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0013a1800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636913.298898:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f417ee41/0x5b741ef42e839644 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.298908:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f417ee41/0x5b741ef42e839644 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.298927:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f417ee41/0x5b741ef42e839644 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.298935:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f417ee41/0x5b741ef42e839644 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.298972:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.298974:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.298975:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.300285:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.300296:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aff559b7/0x5b741ef42e83964b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.300310:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.300315:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.300321:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aff559b7/0x5b741ef42e83964b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.300333:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aff559b7/0x5b741ef42e83964b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.300342:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aff559b7/0x5b741ef42e83964b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.300349:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aff559b7/0x5b741ef42e83964b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.300372:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.303259:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.303275:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aff559b7/0x5b741ef42e83964b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.303289:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.303294:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aff559b7/0x5b741ef42e83964b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.303306:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aff559b7/0x5b741ef42e83964b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.303327:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aff559b7/0x5b741ef42e83964b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.303336:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aff559b7/0x5b741ef42e83964b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.303384:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.303386:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.303388:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.304300:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.304311:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca58ae9/0x5b741ef42e839652 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.304327:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.304339:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.304346:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bca58ae9/0x5b741ef42e839652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.304360:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bca58ae9/0x5b741ef42e839652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.304370:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bca58ae9/0x5b741ef42e839652 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.304378:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bca58ae9/0x5b741ef42e839652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.304404:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636913.304631:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636913.304646:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bca58ae9/0x5b741ef42e839652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.304654:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636913.304658:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca58ae9/0x5b741ef42e839652 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.304666:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bca58ae9/0x5b741ef42e839652 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.304680:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bca58ae9/0x5b741ef42e839652 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.304687:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bca58ae9/0x5b741ef42e839652 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.304704:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.304706:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.304707:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.306003:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.306016:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ec9704/0x5b741ef42e839659 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.306031:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.306035:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.306042:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071ec9704/0x5b741ef42e839659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.306054:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071ec9704/0x5b741ef42e839659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.306064:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ec9704/0x5b741ef42e839659 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.307237:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071ec9704/0x5b741ef42e839659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.307260:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636913.309346:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.309361:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cf430b3/0x5b741ef42e839660 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.309378:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.309382:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.309389:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cf430b3/0x5b741ef42e839660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.309402:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cf430b3/0x5b741ef42e839660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.309412:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cf430b3/0x5b741ef42e839660 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.309420:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cf430b3/0x5b741ef42e839660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.311020:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788636913.312137:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.312149:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000491ecbb/0x5b741ef42e839667 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.312175:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.312179:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.312187:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000491ecbb/0x5b741ef42e839667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.312201:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000491ecbb/0x5b741ef42e839667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.312211:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000491ecbb/0x5b741ef42e839667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.312218:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000491ecbb/0x5b741ef42e839667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.318248:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788636913.318266:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071ec9704/0x5b741ef42e839659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.318268:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636913.318283:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636913.318289:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ec9704/0x5b741ef42e839659 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.318322:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ec9704/0x5b741ef42e839659 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.318346:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071ec9704/0x5b741ef42e839659 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.318358:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071ec9704/0x5b741ef42e839659 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.318389:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636913.318394:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000491ecbb/0x5b741ef42e839667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.318400:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94200 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636913.318403:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000491ecbb/0x5b741ef42e839667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.318411:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000491ecbb/0x5b741ef42e839667 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.318422:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000491ecbb/0x5b741ef42e839667 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.318430:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.318432:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.318442:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.319917:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.319921:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.319924:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.320187:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cf430b3/0x5b741ef42e839660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.320200:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636913.320205:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cf430b3/0x5b741ef42e839660 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.320214:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cf430b3/0x5b741ef42e839660 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.320233:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cf430b3/0x5b741ef42e839660 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.320241:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cf430b3/0x5b741ef42e839660 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.320258:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.320261:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.320263:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636913.320599:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788636913.321193:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636913.321241:0:18712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000491ecbb/0x5b741ef42e839667 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788636913.325321:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.325334:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f93f8df/0x5b741ef42e83966e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.325354:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.325358:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.325365:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f93f8df/0x5b741ef42e83966e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.325397:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f93f8df/0x5b741ef42e83966e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.325407:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f93f8df/0x5b741ef42e83966e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.325414:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f93f8df/0x5b741ef42e83966e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.325436:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.325573:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.325582:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f93f8df/0x5b741ef42e83966e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.325590:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.325595:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f93f8df/0x5b741ef42e83966e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.325605:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f93f8df/0x5b741ef42e83966e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.325622:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f93f8df/0x5b741ef42e83966e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.325630:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f93f8df/0x5b741ef42e83966e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.325650:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.325652:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.325661:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.328535:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.328547:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecfcab97/0x5b741ef42e839675 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.328565:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.328569:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.328575:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecfcab97/0x5b741ef42e839675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.328588:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecfcab97/0x5b741ef42e839675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.328597:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecfcab97/0x5b741ef42e839675 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.328627:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecfcab97/0x5b741ef42e839675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.328658:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.328910:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.328918:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecfcab97/0x5b741ef42e839675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.328929:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.328933:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecfcab97/0x5b741ef42e839675 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.328944:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecfcab97/0x5b741ef42e839675 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.328963:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecfcab97/0x5b741ef42e839675 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.328971:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecfcab97/0x5b741ef42e839675 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.328988:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.328989:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.328991:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.333125:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.333141:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a667f62b/0x5b741ef42e83967c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.333161:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.333166:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.333173:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a667f62b/0x5b741ef42e83967c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.333189:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a667f62b/0x5b741ef42e83967c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.333199:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a667f62b/0x5b741ef42e83967c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.333207:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a667f62b/0x5b741ef42e83967c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.333238:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.333268:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.333277:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a667f62b/0x5b741ef42e83967c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.333288:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.333293:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a667f62b/0x5b741ef42e83967c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.333318:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a667f62b/0x5b741ef42e83967c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.333337:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a667f62b/0x5b741ef42e83967c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.333345:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a667f62b/0x5b741ef42e83967c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.333366:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.333368:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.333370:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.334904:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.334917:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e21b2932/0x5b741ef42e839683 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.334937:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.334941:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.334946:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e21b2932/0x5b741ef42e839683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.334959:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e21b2932/0x5b741ef42e839683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.334969:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e21b2932/0x5b741ef42e839683 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.334976:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e21b2932/0x5b741ef42e839683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.334995:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.336171:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.336181:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e21b2932/0x5b741ef42e839683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.336193:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.336198:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e21b2932/0x5b741ef42e839683 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.336209:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e21b2932/0x5b741ef42e839683 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.336230:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e21b2932/0x5b741ef42e839683 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.336252:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e21b2932/0x5b741ef42e839683 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.336273:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.336275:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.336278:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.336396:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.336403:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bef0a90/0x5b741ef42e83968a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.336413:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.336417:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.336423:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bef0a90/0x5b741ef42e83968a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.336432:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bef0a90/0x5b741ef42e83968a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.336449:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bef0a90/0x5b741ef42e83968a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.336457:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bef0a90/0x5b741ef42e83968a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.336478:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.336523:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.336529:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bef0a90/0x5b741ef42e83968a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.336538:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.336543:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bef0a90/0x5b741ef42e83968a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.336552:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bef0a90/0x5b741ef42e83968a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.336565:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bef0a90/0x5b741ef42e83968a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.336574:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bef0a90/0x5b741ef42e83968a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.336589:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.336591:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.336593:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.337539:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.337548:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b63dc57/0x5b741ef42e839691 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.337560:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.337563:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.337569:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b63dc57/0x5b741ef42e839691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.337579:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b63dc57/0x5b741ef42e839691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.337588:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b63dc57/0x5b741ef42e839691 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.337594:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b63dc57/0x5b741ef42e839691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.337645:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.337726:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.337734:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b63dc57/0x5b741ef42e839691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.337743:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94e00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.337747:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b63dc57/0x5b741ef42e839691 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.337755:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b63dc57/0x5b741ef42e839691 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.337770:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b63dc57/0x5b741ef42e839691 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.337778:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b63dc57/0x5b741ef42e839691 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.337796:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.337798:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.337799:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.338882:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.338892:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000407b2f/0x5b741ef42e839698 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.338905:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.338908:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.338914:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000407b2f/0x5b741ef42e839698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.338924:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000407b2f/0x5b741ef42e839698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.338932:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000407b2f/0x5b741ef42e839698 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.338938:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000407b2f/0x5b741ef42e839698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.338954:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.339273:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.339281:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000407b2f/0x5b741ef42e839698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.339290:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.339295:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000407b2f/0x5b741ef42e839698 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.339321:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000407b2f/0x5b741ef42e839698 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788636913.339326:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.339333:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010490ae3/0x5b741ef42e83969f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.339340:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000407b2f/0x5b741ef42e839698 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.339342:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1788636913.339350:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000407b2f/0x5b741ef42e839698 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.339354:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.339364:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010490ae3/0x5b741ef42e83969f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.339375:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636913.339376:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010490ae3/0x5b741ef42e83969f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.339379:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.339382:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636913.339389:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010490ae3/0x5b741ef42e83969f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.339398:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010490ae3/0x5b741ef42e83969f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.339413:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.339551:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.339557:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010490ae3/0x5b741ef42e83969f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.339566:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.339569:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010490ae3/0x5b741ef42e83969f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.339578:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010490ae3/0x5b741ef42e83969f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.339591:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010490ae3/0x5b741ef42e83969f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.339610:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010490ae3/0x5b741ef42e83969f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.339625:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.339627:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.339629:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.339968:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.339974:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b8ca50/0x5b741ef42e8396a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.339983:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.339986:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.339991:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069b8ca50/0x5b741ef42e8396a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.340001:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069b8ca50/0x5b741ef42e8396a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.340010:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069b8ca50/0x5b741ef42e8396a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.340026:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069b8ca50/0x5b741ef42e8396a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.340043:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636913.340281:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.340288:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069b8ca50/0x5b741ef42e8396a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.340295:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.340299:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b8ca50/0x5b741ef42e8396a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.340307:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069b8ca50/0x5b741ef42e8396a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.340318:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069b8ca50/0x5b741ef42e8396a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.340325:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069b8ca50/0x5b741ef42e8396a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.340339:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.340341:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.340342:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636913.341242:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636913.341251:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa643d4/0x5b741ef42e8396ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.341263:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=582s v=(0 0) 00010000:00010000:3.0:1788636913.341267:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.341273:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa643d4/0x5b741ef42e8396ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.341283:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aa643d4/0x5b741ef42e8396ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.341291:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa643d4/0x5b741ef42e8396ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.341300:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aa643d4/0x5b741ef42e8396ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.341323:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636913.342246:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788636913.342246:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636913.342259:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5517d9d/0x5b741ef42e8396b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.342259:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aa643d4/0x5b741ef42e8396ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.342276:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95e00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636913.342281:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=582s v=(0 0) 00010000:00010000:1.0:1788636913.342283:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa643d4/0x5b741ef42e8396ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.342285:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636913.342295:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5517d9d/0x5b741ef42e8396b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.342301:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa643d4/0x5b741ef42e8396ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.342309:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5517d9d/0x5b741ef42e8396b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.342322:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aa643d4/0x5b741ef42e8396ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.342323:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5517d9d/0x5b741ef42e8396b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.342349:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5517d9d/0x5b741ef42e8396b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.342349:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aa643d4/0x5b741ef42e8396ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.342386:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.342390:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5517d9d/0x5b741ef42e8396b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.342398:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95200 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.342401:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5517d9d/0x5b741ef42e8396b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.342409:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5517d9d/0x5b741ef42e8396b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636913.342421:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788636913.342437:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5517d9d/0x5b741ef42e8396b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.342446:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5517d9d/0x5b741ef42e8396b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.342463:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.342465:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.349616:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636913.356498:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788636913.356524:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7fbe181/0x5b741ef42e8396bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636913.356540:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1788636913.356544:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636913.356551:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7fbe181/0x5b741ef42e8396bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636913.356567:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7fbe181/0x5b741ef42e8396bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636913.356577:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7fbe181/0x5b741ef42e8396bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636913.356584:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7fbe181/0x5b741ef42e8396bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636913.356716:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636913.357320:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788636913.357525:0:18712:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788636913.357533:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29b0256/0x5b741ef42e8396c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636913.357544:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=582s v=(0 0) 00010000:00010000:2.0:1788636913.357547:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636913.357552:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d29b0256/0x5b741ef42e8396c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636913.357562:0:18712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d29b0256/0x5b741ef42e8396c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636913.357571:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29b0256/0x5b741ef42e8396c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636913.357578:0:18712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d29b0256/0x5b741ef42e8396c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.360857:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636913.360873:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d29b0256/0x5b741ef42e8396c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.360886:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636913.360891:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29b0256/0x5b741ef42e8396c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.360903:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29b0256/0x5b741ef42e8396c2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.360926:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d29b0256/0x5b741ef42e8396c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636913.360939:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.360941:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.360944:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636913.363784:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7fbe181/0x5b741ef42e8396bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.363889:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:0.0:1788636913.363895:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7fbe181/0x5b741ef42e8396bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.363937:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7fbe181/0x5b741ef42e8396bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.363961:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7fbe181/0x5b741ef42e8396bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.363970:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7fbe181/0x5b741ef42e8396bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636913.364828:0:18712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636913.364840:0:18712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d29b0256/0x5b741ef42e8396c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636913.364937:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.370949:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.370958:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636913.370961:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788636913.377401:0:18712:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1788636913.377534:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17229:x1875521226093312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 135701us (136015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636913.377546:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788636913.378983:0:17229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17229:1875521226093312:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788636913.379001:0:17229:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788636913.379062:0:17229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17229:1875521226093440:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788636913.379111:0:17229:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636913.379147:0:17229:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0084a5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636913.379302:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226093440 00000100:00100000:1.0:1788636913.379308:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226093440 00000100:00100000:1.0:1788636913.379362:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636913.379371:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17229:x1875521226093440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788636913.379408:0:18713:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1788636913.393438:0:18708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1788636913.393480:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788636913.394859:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17229:x1875521226093440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15481us (15739us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788636913.394873:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636913.396941:0:17229:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788636913.396957:0:17229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17229:1875521226093440:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788636913.396975:0:17229:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1788636913.877968:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636914.326265:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226093568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636914.326341:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636914.329804:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226093568 00000100:00100000:3.0:1788636914.329841:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226093568 00000100:00100000:3.0:1788636914.329897:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636914.329908:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226093568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636914.329933:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788636914.330017:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226093568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (3675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636914.330025:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636914.330075:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226093568:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788636914.901645:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636915.349198:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636915.349223:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226093696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636915.349306:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636915.349547:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226093696 00000100:00100000:3.0:1788636915.349570:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226093696 00000100:00100000:3.0:1788636915.349641:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788636915.349652:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226093696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788636915.349686:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788636915.349735:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226093696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636915.349741:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788636915.349783:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226093696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636915.350558:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226093824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636915.350596:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636915.350770:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226093824 00000100:00100000:3.0:1788636915.350775:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226093824 00000100:00100000:3.0:1788636915.350832:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788636915.350841:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226093824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788636915.350866:0:17946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788636915.350908:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226093824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636915.350915:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788636915.350946:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226093824:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788636915.935579:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788636916.508673:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788636916.951334:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636917.978006:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788636918.214001:0:19525:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788636918.214006:0:19525:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788636918.214008:0:19525:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788636918.214137:0:19525:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cf03b9d4000 00000020:01000004:1.0:1788636918.214154:0:19525:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788636918.214169:0:19525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788636918.214183:0:19525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cf0339dcd40) 00000020:00000080:1.0:1788636918.214201:0:19525:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788636918.289719:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788636918.292804:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788636918.295902:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788636918.296151:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788636918.296424:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788636918.296663:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788636918.296930:0:19525:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1788636918.297784:0:19525:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788636918.299296:0:19525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788636918.299312:0:19525:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788636918.299324:0:19525:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b741ef42e8396d0 00000020:01000004:1.0:1788636918.299332:0:19525:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788636918.299353:0:19525:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788636918.299367:0:19525:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788636918.299373:0:19525:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788636918.299406:0:19525:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788636918.299410:0:19525:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788636918.315970:0:19525:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788636918.316011:0:19525:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.126@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788636918.316016:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788636918.316018:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788636918.316019:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636918.316020:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636918.316021:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636918.316022:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636918.316024:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636918.316026:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636918.316027:0:19525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788636918.316030:0:19525:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788636918.316037:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788636918.316038:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788636918.316039:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636918.316040:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636918.316041:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636918.316042:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636918.316043:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636918.316044:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636918.316045:0:19525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788636918.316074:0:19525:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788636918.316092:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226093952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788636918.316162:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636918.316215:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0245be3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636918.316306:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226093952 00000100:00100000:0.0:1788636918.316315:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226093952 00000100:00100000:0.0:1788636918.316372:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788636918.316382:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+21:19525:x1875521226093952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788636918.316423:0:17196:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788636918.316427:0:17196:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788636918.316431:0:17196:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788636918.316846:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+21:19525:x1875521226093952:12345-0@lo:253:mount.lustre.0 Request processed in 465us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636918.316855:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788636918.316938:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226093952:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788636918.316948:0:19525:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788636918.316950:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788636918.316951:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788636918.316952:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636918.316953:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636918.316954:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636918.316956:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636918.316957:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636918.316958:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636918.316959:0:19525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788636918.316976:0:19525:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf03b9d4000 from lustre-OST0001 10000000:01000000:3.0:1788636918.317000:0:19525:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788636918.317003:0:19525:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788636918.317011:0:19525:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf040bc19c0 local copy 00010000:00010000:3.0:1788636918.317020:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636918.317087:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636918.317113:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636918.317142:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0245be3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636918.317218:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226094080 00000100:00100000:0.0:1788636918.317222:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226094080 00000100:00100000:0.0:1788636918.317251:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788636918.317257:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:19525:x1875521226094080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636918.317367:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:19525:x1875521226094080:12345-0@lo:501:mount.lustre.0 Request processed in 110us (253us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636918.317374:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788636918.317694:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094080:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788636918.317708:0:19525:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788636918.317726:0:19525:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788636918.317732:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.317742:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7000/0x5b741ef42e83931f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839326 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636918.317764:0:19525:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf03b9d4000 10000000:01000000:1.0:1788636918.317768:0:19525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788636918.317773:0:19525:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788636918.317776:0:19525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636918.317780:0:19525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788636918.317783:0:19525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788636918.317804:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36e00/0x5b741ef42e8396d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.317998:0:19525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36e00/0x5b741ef42e8396d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.318009:0:19525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36e00/0x5b741ef42e8396d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636918.318025:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636918.318068:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.318127:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636918.318163:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226094208 00000100:00100000:0.0:1788636918.318168:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226094208 00000100:00100000:0.0:1788636918.318224:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788636918.318231:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+21:19525:x1875521226094208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636918.318241:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636918.318259:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8396de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8396d7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636918.318280:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8396de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8396d7 expref: 22 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636918.318290:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c7400/0x5b741ef42e8396de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8396d7 expref: 22 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636918.318299:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7400, rc 0) 00000100:00100000:0.0:1788636918.318334:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+22:19525:x1875521226094208:12345-0@lo:101:mount.lustre.0 Request processed in 103us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636918.318340:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788636918.318395:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636918.318408:0:19525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36e00/0x5b741ef42e8396d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8396de expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.318418:0:19525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36e00/0x5b741ef42e8396d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8396de expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636918.319439:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788636918.320059:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636918.323344:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788636918.323401:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788636918.323417:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788636918.323429:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788636918.323441:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788636918.323452:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788636918.323473:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788636918.323478:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788636918.324958:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636918.325028:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.325092:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf02442e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636918.327168:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226094336 00000100:00100000:0.0:1788636918.327183:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226094336 00000100:00100000:1.0:1788636918.327329:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788636918.327339:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+22:19525:x1875521226094336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636918.327546:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+22:19525:x1875521226094336:12345-0@lo:501:mount.lustre.0 Request processed in 207us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.327554:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788636918.327632:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636918.327691:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636918.327733:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.327751:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0031e8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636918.327767:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226094464 00000100:00100000:1.0:1788636918.327770:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226094464 00000100:00100000:1.0:1788636918.327789:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788636918.327794:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+22:19525:x1875521226094464:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636918.328912:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+22:19525:x1875521226094464:12345-0@lo:503:mount.lustre.0 Request processed in 1113us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.328922:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788636918.329063:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094464:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788636918.329489:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636918.329571:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636918.329631:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.329667:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788636918.329736:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226094592 00000100:00100000:0.0:1788636918.329742:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226094592 00000100:00100000:0.0:1788636918.329785:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788636918.329795:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+22:19525:x1875521226094592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788636918.330290:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+22:19525:x1875521226094592:12345-0@lo:502:mount.lustre.0 Request processed in 495us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636918.330299:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788636918.330406:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636918.330622:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788636918.330653:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788636918.330669:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788636918.330684:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788636918.330698:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788636918.330710:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788636918.330724:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788636918.330737:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788636918.330751:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788636918.330775:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636918.332230:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.332279:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636918.332445:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226094720 00000100:00100000:3.0:1788636918.332454:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226094720 00000100:00100000:3.0:1788636918.332500:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788636918.332520:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+22:19525:x1875521226094720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636918.332661:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+22:19525:x1875521226094720:12345-0@lo:502:mount.lustre.0 Request processed in 153us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636918.332669:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788636918.333020:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636918.333104:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788636918.333118:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788636918.333856:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788636918.333864:0:19529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788636918.333872:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636918.333874:0:19529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788636918.333880:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636918.333896:0:19529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cf03a60cd40) 00000020:00000080:0.0:1788636918.333920:0:19529:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788636918.333927:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788636918.334007:0:19529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf03b9d4000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788636918.334016:0:19529:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788636918.334023:0:19529:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5b741ef42e8396ec 00010000:00010000:1.0:1788636918.342911:0:19529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788636918.343996:0:19529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788636918.345397:0:19529:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788636918.348097:0:19529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788636918.348110:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636918.348119:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636918.348121:0:19529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788636918.348127:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636918.348131:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636918.348132:0:19529:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788636918.348135:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788636918.348137:0:19529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788636918.348139:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636918.348141:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636918.348142:0:19529:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788636918.348144:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636918.348147:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636918.348148:0:19529:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788636918.348151:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788636918.348182:0:19529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636918.348184:0:19529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636918.348186:0:19529:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788636918.348189:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788636918.348455:0:19525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788636918.348489:0:19525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788636918.348522:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36e00/0x5b741ef42e8396d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8396de expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.348535:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36e00/0x5b741ef42e8396d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8396de expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636918.348543:0:19525:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf03b9d4000 from 1 10000000:01000000:1.0:1788636918.348547:0:19525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636918.348586:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.348594:0:19525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.348633:0:19525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636918.348659:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636918.348723:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.348763:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0031e8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788636918.349083:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226094848 00000100:00100000:3.0:1788636918.349090:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226094848 00000100:00100000:3.0:1788636918.349131:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788636918.349140:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+22:19525:x1875521226094848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636918.349164:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636918.349177:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf004b95200/0x5b741ef42e8396fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8396f3 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.349199:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf004b95200/0x5b741ef42e8396fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8396f3 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.349209:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf004b95200/0x5b741ef42e8396fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8396f3 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.349217:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b95200, rc 0) 00000100:00100000:3.0:1788636918.349262:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+23:19525:x1875521226094848:12345-0@lo:101:mount.lustre.0 Request processed in 123us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636918.349269:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788636918.349376:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636918.349391:0:19525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.349400:0:19525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636918.350419:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788636918.351086:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636918.351267:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788636918.351291:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788636918.351309:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788636918.351315:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788636918.351394:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636918.351457:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.352558:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf02442e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636918.367596:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226094976 00000100:00100000:3.0:1788636918.367622:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226094976 00000100:00100000:3.0:1788636918.367688:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788636918.367699:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+23:19525:x1875521226094976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636918.367886:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+23:19525:x1875521226094976:12345-0@lo:501:mount.lustre.0 Request processed in 188us (16428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636918.367894:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788636918.369993:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226094976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636918.370053:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636918.370125:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.370203:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf02442e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636918.375797:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226095104 00000100:00100000:3.0:1788636918.375925:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226095104 00000100:00100000:3.0:1788636918.376010:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788636918.376021:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+23:19525:x1875521226095104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636918.376190:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+23:19525:x1875521226095104:12345-0@lo:503:mount.lustre.0 Request processed in 162us (6055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636918.376209:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788636918.376310:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788636918.376909:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636918.376984:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636918.377033:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.382895:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636918.383224:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226095232 00000100:00100000:1.0:1788636918.383234:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226095232 00000100:00100000:1.0:1788636918.383287:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788636918.383296:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+23:19525:x1875521226095232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636918.383505:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+23:19525:x1875521226095232:12345-0@lo:502:mount.lustre.0 Request processed in 209us (6470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.383523:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788636918.383720:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788636918.384576:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788636918.385304:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788636918.385326:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788636918.385341:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788636918.385355:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788636918.385366:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788636918.385377:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788636918.385390:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788636918.385404:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788636918.385416:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788636918.385429:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788636918.385472:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636918.385553:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.385591:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0011caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636918.390249:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226095360 00000100:00100000:3.0:1788636918.390266:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226095360 00000100:00100000:3.0:1788636918.390329:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788636918.390339:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+23:19525:x1875521226095360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636918.390521:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+23:19525:x1875521226095360:12345-0@lo:502:mount.lustre.0 Request processed in 172us (4957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636918.390530:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788636918.391004:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788636918.391092:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788636918.391105:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788636918.391781:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636918.391791:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636918.391793:0:19533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788636918.391800:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf03b9d4000 00000020:00000080:2.0:1788636918.391803:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788636918.391876:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636918.391880:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636918.391882:0:19533:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788636918.391885:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636918.391888:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636918.391889:0:19533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788636918.391893:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf03b9d4000 00000020:00000080:2.0:1788636918.391895:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788636918.391950:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636918.391954:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636918.391955:0:19533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788636918.391958:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636918.391960:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636918.391961:0:19533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788636918.391964:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf03b9d4000 00000020:00000080:2.0:1788636918.391966:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788636918.391982:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636918.391984:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636918.391986:0:19533:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788636918.391994:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636918.391997:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636918.391998:0:19533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788636918.392001:0:19533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf03b9d4000 00000020:00000080:2.0:1788636918.392003:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788636918.392024:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636918.392027:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636918.392028:0:19533:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788636918.392031:0:19533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788636918.393749:0:19525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788636918.393796:0:19525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636918.393837:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.393861:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636918.393922:0:19525:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788636918.393925:0:19525:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf03b9d4000 10000000:01000000:1.0:1788636918.393928:0:19525:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf03b9d4000 10000000:01000000:1.0:1788636918.393933:0:19525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636918.393939:0:19525:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf03b9d4000 from 1 10000000:01000000:1.0:1788636918.393942:0:19525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788636918.393985:0:19525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e839701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.393994:0:19525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e839701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.394007:0:19525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e839701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636918.394032:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636918.394101:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.394138:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00817f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788636918.400033:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226095488 00000100:00100000:3.0:1788636918.400047:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226095488 00000100:00100000:3.0:1788636918.400109:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788636918.400118:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+23:19525:x1875521226095488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636918.400134:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636918.400151:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf004b94200/0x5b741ef42e839708 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e839701 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.400178:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf004b94200/0x5b741ef42e839708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e839701 expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.400189:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf004b94200/0x5b741ef42e839708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e839701 expref: 24 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.400199:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b94200, rc 0) 00000100:00100000:3.0:1788636918.405236:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226095488:12345-0@lo:101:mount.lustre.0 Request processed in 5108us (11124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636918.405250:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788636918.406981:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636918.407009:0:19525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e839701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839708 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.407022:0:19525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e839701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839708 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636918.409412:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788636918.410128:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636918.410330:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788636918.410355:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788636918.410369:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788636918.410380:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788636918.410391:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788636918.410402:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788636918.410417:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788636918.410432:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788636918.410445:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788636918.410459:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788636918.410473:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788636918.410486:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788636918.410496:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788636918.410534:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788636918.410550:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788636918.410561:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788636918.410571:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788636918.410581:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788636918.410592:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788636918.410603:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788636918.412023:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788636918.412054:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788636918.412066:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788636918.412078:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788636918.412089:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788636918.412100:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788636918.412112:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788636918.412123:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788636918.412134:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788636918.412165:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788636918.412177:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788636918.412188:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788636918.412199:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788636918.412210:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788636918.412221:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788636918.412232:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788636918.412244:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788636918.412256:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788636918.412268:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788636918.412280:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788636918.412292:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788636918.412305:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788636918.412318:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788636918.412330:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788636918.412342:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788636918.412367:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788636918.412395:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788636918.412401:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788636918.414912:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636918.414982:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.415058:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0011caf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636918.421405:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226095616 00000100:00100000:2.0:1788636918.421424:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226095616 00000100:00100000:2.0:1788636918.421489:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788636918.421500:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226095616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636918.421782:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226095616:12345-0@lo:501:mount.lustre.0 Request processed in 283us (6798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636918.421790:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788636918.422027:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636918.422079:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636918.422127:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.422156:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf02442e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636918.422179:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226095744 00000100:00100000:2.0:1788636918.422184:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226095744 00000100:00100000:2.0:1788636918.422209:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788636918.422216:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226095744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636918.422295:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226095744:12345-0@lo:503:mount.lustre.0 Request processed in 79us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636918.422302:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788636918.422347:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095744:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788636918.423929:0:19525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636918.424009:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636918.424069:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.424091:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636918.424115:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226095872 00000100:00100000:2.0:1788636918.424121:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226095872 00000100:00100000:2.0:1788636918.424154:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788636918.424162:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226095872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636918.424251:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226095872:12345-0@lo:502:mount.lustre.0 Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636918.424259:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788636918.424306:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226095872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636918.424467:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788636918.424488:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788636918.424500:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788636918.424530:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788636918.424555:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788636918.424568:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788636918.424578:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788636918.424589:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788636918.424600:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788636918.425774:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788636918.425828:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788636918.425848:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788636918.425909:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788636918.425928:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788636918.425943:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788636918.425972:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788636918.425987:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788636918.426001:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788636918.426014:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788636918.426031:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788636918.426062:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788636918.426080:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788636918.426093:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788636918.426108:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788636918.426122:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788636918.426136:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788636918.426151:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788636918.426165:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788636918.426178:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788636918.426191:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788636918.426204:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788636918.426218:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788636918.426231:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788636918.426245:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788636918.426258:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788636918.426272:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788636918.426299:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788636918.426314:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788636918.426329:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788636918.426342:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788636918.426355:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788636918.426369:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788636918.426384:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788636918.426399:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788636918.426415:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788636918.426428:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788636918.426442:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788636918.426457:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788636918.432212:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226096000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636918.432295:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.432340:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226096000 00000100:00100000:2.0:1788636918.432348:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226096000 00000100:00100000:2.0:1788636918.432392:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788636918.432404:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226096000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636918.432542:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226096000:12345-0@lo:502:mount.lustre.0 Request processed in 141us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636918.432550:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788636918.432599:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636918.432987:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226096000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636918.433192:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788636918.433220:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788636918.433249:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226096128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636918.433288:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.433315:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636918.433738:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226096384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636918.433769:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636918.433800:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226096384 00000100:00100000:0.0:1788636918.433825:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226096384 00000100:00100000:0.0:1788636918.433913:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636918.433922:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226096384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636918.433943:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788636918.433976:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226096384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636918.433983:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788636918.433999:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636918.434024:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226096384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788636918.434712:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636918.434719:0:16613:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788636918.434723:0:16613:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636918.434729:0:16613:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 582 00000100:00080000:1.0:1788636918.434734:0:16613:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788636918.434739:0:16613:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf032424800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636918.434764:0:16613:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf00f178e00 x1875521226096512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636918.434837:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636918.434840:0:16613:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788636918.434842:0:16613:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636918.434846:0:16613:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 582 00000100:00080000:1.0:1788636918.434848:0:16613:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788636918.434853:0:16613:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cf032136000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:2.0:1788636918.434995:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226096256:0@lo:400:kworker.0 00000100:00100000:2.0:1788636918.435054:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.435081:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226096896:0@lo:400:kworker.0 00000100:00100000:2.0:1788636918.435105:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.435126:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636918.435131:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226096768:0@lo:400:kworker.0 00000100:00100000:2.0:1788636918.435165:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.435192:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226096640:0@lo:400:kworker.0 00000100:00100000:2.0:1788636918.435216:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.435256:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226096256 00000100:00100000:2.0:1788636918.435262:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226096256 00000100:00100000:2.0:1788636918.435293:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226096768 00000100:00100000:2.0:1788636918.435297:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226096768 00000100:00100000:2.0:1788636918.435311:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788636918.435319:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226096256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636918.435364:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226096256:12345-0@lo:400:kworker.0 Request processed in 46us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636918.435371:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788636918.435384:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788636918.435390:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226096768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636918.435414:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226096768:12345-0@lo:400:kworker.0 Request processed in 24us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636918.435420:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788636918.435437:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226096640 00000100:00100000:2.0:1788636918.435440:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226096640 00000100:00100000:2.0:1788636918.435462:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636918.435469:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226096640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636918.435496:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226096640:12345-0@lo:400:kworker.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636918.435502:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636918.435546:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226096768:0@lo:400:kworker.0 00000100:00100000:2.0:1788636918.435556:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226096256:0@lo:400:kworker.0 00010000:00080000:2.0:1788636918.435582:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f17a300 x1875521226096640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636918.435592:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226096640:0@lo:400:kworker.0 00000100:00100000:3.0:1788636918.435740:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226096128 00000100:00100000:3.0:1788636918.435750:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226096128 00000100:00100000:3.0:1788636918.435782:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788636918.435788:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226096128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636918.435970:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226096128:12345-0@lo:502:mount.lustre.0 Request processed in 180us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636918.435977:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788636918.436406:0:16613:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf00f17ad80 x1875521226097024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636918.436464:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226097408:0@lo:400:kworker.0 00000100:00100000:1.0:1788636918.436495:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.436537:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226096512:0@lo:8:kworker.0 00000100:00100000:1.0:1788636918.436560:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.436576:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226097024:0@lo:8:kworker.0 00000100:00100000:1.0:1788636918.436591:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.436687:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226097152:0@lo:400:kworker.0 00000100:00100000:1.0:1788636918.436709:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.436726:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636918.436730:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226097280:0@lo:400:kworker.0 00000100:00100000:1.0:1788636918.436748:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.436770:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226096896 00000100:00100000:1.0:1788636918.436774:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226096896 00000100:00100000:1.0:1788636918.436831:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226096512 00000100:00100000:1.0:1788636918.436834:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226096512 00000100:00100000:1.0:1788636918.436843:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226097024 00000100:00100000:1.0:1788636918.436845:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226097024 00000100:00100000:1.0:1788636918.436867:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636918.436874:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226096896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636918.436911:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226096896:12345-0@lo:400:kworker.0 Request processed in 38us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.436917:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636918.436931:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788636918.436935:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226096512:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788636918.436988:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226096512:12345-0@lo:8:kworker.0 Request processed in 51us (426us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788636918.436995:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788636918.437006:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788636918.437010:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226097024:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788636918.437034:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3645:x1875521226097024:12345-0@lo:8:kworker.0 Request processed in 23us (442us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788636918.437040:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788636918.437071:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226097408 00000100:00100000:1.0:1788636918.437074:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226097408 00000100:00100000:1.0:1788636918.437088:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226097152 00000100:00100000:1.0:1788636918.437090:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226097152 00000100:00100000:1.0:1788636918.437097:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226097280 00000100:00100000:1.0:1788636918.437100:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226097280 00000100:00100000:1.0:1788636918.437111:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788636918.437116:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226097408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636918.437145:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226097408:12345-0@lo:400:kworker.0 Request processed in 29us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.437151:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788636918.437160:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788636918.437165:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226097152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636918.437198:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875521226097152:12345-0@lo:400:kworker.0 Request processed in 33us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.437204:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788636918.437216:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788636918.437222:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226097280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636918.437245:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875521226097280:12345-0@lo:400:kworker.0 Request processed in 23us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.437250:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788636918.437277:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636918.437280:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636918.437283:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636918.437304:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636918.437311:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636918.437316:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788636918.437319:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226096512:0@lo:8:kworker.0 00000100:00100000:1.0:1788636918.437327:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636918.437330:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636918.437333:0:3645:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788636918.437335:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226097024:0@lo:8:kworker.0 00010000:00080000:1.0:1788636918.437378:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f178700 x1875521226097408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636918.437389:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226097408:0@lo:400:kworker.0 00010000:00080000:1.0:1788636918.437404:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f178a80 x1875521226097280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636918.437413:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3648:1875521226097280:0@lo:400:kworker.0 00010000:00080000:1.0:1788636918.437428:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f17a300 x1875521226097152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636918.437436:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875521226097152:0@lo:400:kworker.0 00000100:00100000:2.0:1788636918.438902:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226096128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636918.439000:0:19525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788636918.439015:0:19525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:3.0:1788636918.439604:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226096896:0@lo:400:kworker.0 00000020:01000004:1.0:1788636918.439946:0:19539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788636918.439974:0:19539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cef010b19c0) 00000020:00000080:1.0:1788636918.439998:0:19539:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1788636918.440074:0:19539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf03b9d4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788636918.440079:0:19539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf03b9d4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788636918.440081:0:19539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf03b9d4000 3 00010000:00080000:1.0:1788636918.440112:0:19539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef034ef800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.126@tcp at head 00010000:00010000:1.0:1788636918.443198:0:19539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788636918.443406:0:19539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788636918.443447:0:19539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788636918.443458:0:19539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5b741ef42e839716 00000100:00080000:1.0:1788636918.443468:0:19539:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636918.443474:0:19539:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cef034ef800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636918.443528:0:19539:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf00f17a300 x1875521226097536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636918.443561:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226097536:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788636918.444722:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.444790:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226097536 00000100:00100000:1.0:1788636918.444796:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226097536 00000100:00100000:1.0:1788636918.444838:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636918.444846:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3645:x1875521226097536:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788636918.444871:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:1.0:1788636918.444912:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5b741ef42e83971d 00000004:00100000:1.0:1788636918.444929:0:17204:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788636918.444959:0:17204:0:(import.c:65:import_set_state_nolock()) ffff9cf03b9d0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636918.445009:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875521226097536:12345-0@lo:38:llog_process_th.0 Request processed in 163us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.445017:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788636918.445055:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f17a300 x1875521226097536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636918.445066:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636918.445073:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788636918.445078:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788636918.445082:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788636918.445084:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef034ef800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788636918.445090:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3645:1875521226097536:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788636918.445106:0:19539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1788636918.448448:0:19539:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788636918.448466:0:19539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9cef010b0000) 00000020:00000080:1.0:1788636918.448490:0:19539:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788636918.448571:0:19539:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf03b9d4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788636918.448575:0:19539:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf03b9d4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788636918.448578:0:19539:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf03b9d4000 3 00010000:00080000:1.0:1788636918.448606:0:19539:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef034ed800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.126@tcp at head 00010000:00010000:1.0:1788636918.458873:0:19539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788636918.461456:0:19539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788636918.461515:0:19539:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788636918.461540:0:19539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5b741ef42e83972b 00000100:00080000:1.0:1788636918.461552:0:19539:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636918.461559:0:19539:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9cef034ed800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636918.461599:0:19539:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf00f17a300 x1875521226097664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636918.462221:0:19539:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788636918.462318:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875521226097664:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788636918.462392:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.462963:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226097664 00000100:00100000:1.0:1788636918.462971:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226097664 00000100:00100000:1.0:1788636918.463006:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788636918.463014:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3645:x1875521226097664:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788636918.463053:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:1.0:1788636918.463103:0:17205:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5b741ef42e839732 00000004:00100000:1.0:1788636918.463118:0:17205:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788636918.463149:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9cef0275c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636918.463215:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875521226097664:12345-0@lo:38:llog_process_th.0 Request processed in 201us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.463223:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788636918.463913:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf00f17a300 x1875521226097664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636918.463925:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788636918.463933:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788636918.463940:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788636918.463944:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788636918.463947:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cef034ed800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788636918.463954:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3645:1875521226097664:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788636918.472116:0:19539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788636918.472430:0:19525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788636918.472464:0:19525:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788636918.472486:0:19525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e839701 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839708 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636918.472497:0:19525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37c00/0x5b741ef42e839701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839708 expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788636918.472559:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788636918.472562:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788636918.472563:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636918.472564:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636918.472565:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636918.472566:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636918.472568:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636918.472570:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636918.472571:0:19525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636918.472575:0:19525:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788636918.472578:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788636918.472579:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788636918.472581:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636918.472582:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636918.472583:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636918.472584:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636918.472585:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636918.472586:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636918.472587:0:19525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636918.472704:0:19525:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788636918.472730:0:19525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226097792:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788636918.472792:0:19525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636918.472851:0:19525:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788636918.472942:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226097792 00000100:00100000:0.0:1788636918.472951:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226097792 00000100:00100000:0.0:1788636918.472999:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788636918.473008:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226097792:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788636918.473053:0:17198:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788636918.473064:0:17198:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788636918.474490:0:17198:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788636918.474518:0:17198:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788636918.474748:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+24:19525:x1875521226097792:12345-0@lo:253:mount.lustre.0 Request processed in 1738us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636918.474759:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 20000000:01000000:1.0:1788636918.474863:0:17220:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788636918.474868:0:17220:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788636918.474887:0:17220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.474903:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e8395e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8395db expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.474911:0:17220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e8395f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8395e9 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.474918:0:17220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.474959:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e8395f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8395e9 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.474972:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e8395f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8395e9 expref: 23 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636918.474985:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226097920:0@lo:104: 00000100:00100000:1.0:1788636918.475020:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636918.475071:0:17220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e8395e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8395db expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.475080:0:17220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e8395e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8395db expref: 23 pid: 17196 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636918.475089:0:17220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226098048:0@lo:104: 00000100:00100000:1.0:1788636918.475109:0:17220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636918.475125:0:17220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04097b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636918.475142:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226097920 00000100:00100000:1.0:1788636918.475147:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226097920 00000100:00100000:1.0:1788636918.475176:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226098048 00000100:00100000:1.0:1788636918.475252:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226098048 00000100:00100000:1.0:1788636918.475273:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636918.475281:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7a34533-966f-4857-8403-9471b802ebf2+4:17220:x1875521226097920:12345-0@lo:104: 00010000:00010000:1.0:1788636918.475294:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.475337:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636918.475343:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7a34533-966f-4857-8403-9471b802ebf2+4:17220:x1875521226097920:12345-0@lo:104: Request processed in 63us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.475355:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636918.475368:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788636918.475375:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7a34533-966f-4857-8403-9471b802ebf2+3:17220:x1875521226098048:12345-0@lo:104: 00010000:00010000:1.0:1788636918.475382:0:17188:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.475415:0:17188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788636918.475420:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c7a34533-966f-4857-8403-9471b802ebf2+3:17220:x1875521226098048:12345-0@lo:104: Request processed in 46us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636918.475426:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788636918.475440:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636918.475446:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.475454:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6600 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636918.475458:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.475466:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636918.475474:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636918.475479:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788636918.475787:0:19525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c7a34533-966f-4857-8403-9471b802ebf2:19525:1875521226097792:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788636918.475800:0:19525:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788636918.475803:0:19525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636918.475825:0:19525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788636918.475827:0:19525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636918.475828:0:19525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636918.475829:0:19525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636918.475830:0:19525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636918.475832:0:19525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636918.475833:0:19525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636918.475834:0:19525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788636918.475849:0:19525:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788636918.476491:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.476499:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636918.476545:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.476553:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6600/0x5b741ef42e8395e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8395f0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.476566:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636918.476570:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.476577:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36c00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:1.0:1788636918.476580:0:17193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.476588:0:17193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636918.476595:0:17193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636918.476600:0:17193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1788636918.477119:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226098176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636918.477166:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636918.477281:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226098176 00000100:00100000:0.0:1788636918.477287:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226098176 00010000:00010000:0.0:1788636918.477311:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e8395f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8395e9 expref: 24 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636918.477339:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788636918.477347:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7a34533-966f-4857-8403-9471b802ebf2+24:3647:x1875521226098176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636918.477358:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636918.477364:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e8395f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8395e9 expref: 24 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636918.477376:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e8395f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8395e9 expref: 24 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636918.477392:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636918.477421:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7a34533-966f-4857-8403-9471b802ebf2+24:3647:x1875521226098176:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636918.477428:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788636918.477457:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226098176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636918.477535:0:17193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.477542:0:17193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636918.477568:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.477575:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36c00/0x5b741ef42e8395db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8395e2 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.477601:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636918.477603:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636918.477605:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636918.477745:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226098304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636918.477769:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636918.478097:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226098304 00000100:00100000:3.0:1788636918.478102:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226098304 00010000:00010000:3.0:1788636918.478120:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e8395e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8395db expref: 24 pid: 17196 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636918.478141:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636918.478147:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+24:3648:x1875521226098304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636918.478155:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636918.478159:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e8395e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8395db expref: 24 pid: 17196 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.478188:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e8395e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8395db expref: 24 pid: 17196 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.478203:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.478212:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788636918.478225:0:17189:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012614678s 00010000:00010000:3.0:1788636918.478230:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.478237:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.478244:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.478250:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.478255:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636918.478259:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.478266:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.478274:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636918.478289:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636918.478333:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+24:3648:x1875521226098304:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636918.478339:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788636918.478665:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226098304:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788636918.479391:0:19525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788636918.482020:0:19525:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788636918.482041:0:19525:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788636918.482082:0:19525:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788636918.482134:0:19525:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788636918.482156:0:19525:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788636918.482176:0:19525:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788636918.483072:0:19525:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788636918.483317:0:19525:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788636918.489079:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e8395f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8395e9 expref: 23 pid: 17199 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636918.489102:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226097920:0@lo:104: 00010000:00010000:0.0:1788636918.489118:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03aab1c00/0x5b741ef42e8395e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8395db expref: 22 pid: 17196 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636918.489136:0:17220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17220:1875521226098048:0@lo:104: 00010000:00010000:0.0:1788636918.489162:0:17220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636918.489172:0:17220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636918.489179:0:17220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636918.489186:0:17220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839739 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636918.490362:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636919.001659:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636919.450148:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226098432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636919.450226:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636919.450308:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226098432 00000100:00100000:3.0:1788636919.450317:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226098432 00000100:00100000:3.0:1788636919.450383:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788636919.450392:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226098432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636919.450416:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788636919.451662:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226098432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1265us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636919.451674:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636919.453481:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226098432:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1788636919.457754:0:19592:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788636919.458059:0:19592:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788636919.636962:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788636919.636969:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf0113d7000 from 10 10000000:01000000:0.0:1788636919.636973:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788636919.637021:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6e00/0x5b741ef42e839740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636919.637030:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6e00/0x5b741ef42e839740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636919.637038:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6e00/0x5b741ef42e839740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636919.637058:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226098560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636919.637149:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636919.637212:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040923780 going to sleep for 11 seconds 00000100:00100000:2.0:1788636919.642477:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226098560 00000100:00100000:2.0:1788636919.642495:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226098560 00000100:00100000:2.0:1788636919.642638:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788636919.642651:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+22:17201:x1875521226098560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636919.642670:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636919.642692:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e839747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e839740 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636919.642727:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e839747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e839740 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636919.642759:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab0600/0x5b741ef42e839747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e839740 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636919.642769:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0600, rc 0) 00000100:00100000:2.0:1788636919.643013:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+23:17201:x1875521226098560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 364us (5862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636919.643021:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788636919.643103:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226098560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636919.643123:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6e00/0x5b741ef42e839740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839747 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636919.643133:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6e00/0x5b741ef42e839740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839747 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636919.643204:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226098688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788636919.643250:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636919.643651:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571540 going to sleep for 11 seconds 00000100:00100000:0.0:1788636919.643799:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226098688 00000100:00100000:0.0:1788636919.643831:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226098688 00000100:00100000:0.0:1788636919.643865:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788636919.643873:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+23:17201:x1875521226098688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788636919.643892:0:17198:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788636919.643912:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788636919.643915:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788636919.644017:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+23:17201:x1875521226098688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636919.644025:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788636919.644141:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226098688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788636919.644203:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788636919.644212:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6e00/0x5b741ef42e839740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839747 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636919.644221:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c6e00/0x5b741ef42e839740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839747 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636919.644231:0:17201:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788636919.644234:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cef03105000 from 10 10000000:01000000:1.0:1788636919.644237:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788636919.644262:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36a00/0x5b741ef42e83974e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636919.644277:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36a00/0x5b741ef42e83974e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636919.644285:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36a00/0x5b741ef42e83974e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636919.644302:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226098816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636919.644540:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636919.644571:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571540 going to sleep for 11 seconds 00000100:00100000:0.0:1788636919.644626:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226098816 00000100:00100000:0.0:1788636919.644632:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226098816 00000100:00100000:0.0:1788636919.644652:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788636919.644658:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+23:17201:x1875521226098816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636919.644666:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636919.644677:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6200/0x5b741ef42e839755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e83974e expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636919.644696:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6200/0x5b741ef42e839755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e83974e expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636919.644706:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6200/0x5b741ef42e839755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83974e expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636919.644714:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6200, rc 0) 00000100:00100000:0.0:1788636919.644753:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+24:17201:x1875521226098816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636919.644765:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788636919.644917:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226098816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636919.644928:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36a00/0x5b741ef42e83974e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839755 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636919.644936:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36a00/0x5b741ef42e83974e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e839755 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636919.644976:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226098944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788636919.645006:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636919.645022:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636919.645101:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226098944 00000100:00100000:2.0:1788636919.645105:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226098944 00000100:00100000:2.0:1788636919.645130:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788636919.645136:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:17201:x1875521226098944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788636919.645147:0:17199:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788636919.645160:0:17199:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788636919.645163:0:17199:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788636919.645239:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:17201:x1875521226098944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636919.645246:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788636919.645292:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226098944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788636919.645584:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788636919.645592:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36a00/0x5b741ef42e83974e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839755 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636919.645600:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36a00/0x5b741ef42e83974e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e839755 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636920.021284:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788636920.342580:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788636920.469186:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226099200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636920.469293:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636920.469350:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636920.469356:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226099072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636920.469380:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636920.469415:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226099200 00000100:00100000:0.0:1788636920.469424:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226099200 00000100:00100000:0.0:1788636920.469478:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226099072 00000100:00100000:0.0:1788636920.469482:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226099072 00000100:00100000:0.0:1788636920.469510:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788636920.469520:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226099200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636920.469565:0:17946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788636920.469623:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226099200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636920.469630:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788636920.469649:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788636920.469654:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226099072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788636920.469699:0:17946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788636920.469727:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226099072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636920.469732:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788636920.469778:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226099072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636920.469791:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226099200:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788636921.050571:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636922.075437:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.101725:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788636923.541171:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636923.541180:0:16613:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788636923.541184:0:16613:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636923.541208:0:16613:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf032424800 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636923.541236:0:16613:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf00f178e00 x1875521226099712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636923.541340:0:16613:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788636923.541344:0:16613:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788636923.541345:0:16613:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636923.541351:0:16613:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9cf032136000 using connection 192.168.202.126@tcp/0@lo 00000100:00100000:1.0:1788636923.541362:0:16613:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef019b1f80 x1875521226100224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636923.541438:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541522:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541562:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226099968:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541586:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541603:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226100608:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541624:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541646:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788636923.541652:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226099456:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541671:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541686:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226100096:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541708:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541724:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226100736:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541743:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541771:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226099584:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541791:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541841:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226100352:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541862:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541875:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226100864:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541896:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541906:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788636923.541911:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0237d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226099840:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541929:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541938:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226100480:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.541955:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.541981:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226099328 00000100:00100000:1.0:1788636923.541988:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226099328 00000100:00100000:1.0:1788636923.542030:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788636923.542040:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:3648:x1875521226099328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.542089:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:3648:x1875521226099328:12345-0@lo:400:kworker.0 Request processed in 50us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636923.542097:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788636923.542126:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226099968 00000100:00100000:1.0:1788636923.542130:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226099968 00000100:00100000:1.0:1788636923.542150:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226099456 00000100:00100000:1.0:1788636923.542151:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226099456 00000100:00100000:1.0:1788636923.542164:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788636923.542169:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226099968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.542202:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226099968:12345-0@lo:400:kworker.0 Request processed in 33us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636923.542207:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788636923.542219:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788636923.542225:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226099456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636923.542702:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226099712:0@lo:8:kworker.0 00000100:00100000:3.0:1788636923.542744:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636923.542767:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226100224:0@lo:8:kworker.0 00000100:00100000:3.0:1788636923.542790:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636923.542837:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226100096 00000100:00100000:3.0:1788636923.542842:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226100096 00000100:00100000:3.0:1788636923.542881:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226099584 00000100:00100000:3.0:1788636923.542884:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226099584 00000100:00100000:3.0:1788636923.542897:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226099712 00000100:00100000:3.0:1788636923.542899:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226099712 00000100:00100000:3.0:1788636923.542906:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226100224 00000100:00100000:3.0:1788636923.542908:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226100224 00000100:00100000:3.0:1788636923.542917:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636923.542924:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226100096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636923.542958:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226100096:12345-0@lo:400:kworker.0 Request processed in 34us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636923.542964:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636923.542976:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636923.542982:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226099584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636923.543026:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226099584:12345-0@lo:400:kworker.0 Request processed in 44us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636923.543032:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636923.543044:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636923.543048:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875521226099712:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788636923.543077:0:18713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:3.0:1788636923.543108:0:18713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5b741ef42e83975c 00002000:00100000:3.0:1788636923.543124:0:18713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cef03754000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788636923.543129:0:18713:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788636923.543132:0:18713:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788636923.543551:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226099456:12345-0@lo:400:kworker.0 Request processed in 1324us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636923.543560:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788636923.543583:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226100608 00000100:00100000:1.0:1788636923.543598:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226100608 00000100:00100000:1.0:1788636923.543622:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226100736 00000100:00100000:1.0:1788636923.543625:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226100736 00000100:00100000:1.0:1788636923.543639:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226100352 00000100:00100000:1.0:1788636923.543642:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226100352 00000100:00100000:1.0:1788636923.543651:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226100864 00000100:00100000:1.0:1788636923.543654:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226100864 00000100:00100000:1.0:1788636923.543664:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226099840 00000100:00100000:1.0:1788636923.543667:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226099840 00000100:00100000:1.0:1788636923.543677:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226100480 00000100:00100000:1.0:1788636923.543679:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226100480 00000100:00100000:1.0:1788636923.543692:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788636923.543698:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226100608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.543733:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226100608:12345-0@lo:400:kworker.0 Request processed in 35us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636923.543740:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788636923.543752:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788636923.543757:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226100736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.543783:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226100736:12345-0@lo:400:kworker.0 Request processed in 26us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636923.543789:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788636923.543798:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788636923.543804:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226100352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.543848:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226100352:12345-0@lo:400:kworker.0 Request processed in 44us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636923.543862:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788636923.543873:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788636923.543878:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226100864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.543905:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226100864:12345-0@lo:400:kworker.0 Request processed in 26us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636923.543910:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788636923.543920:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788636923.543925:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226099840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.543949:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226099840:12345-0@lo:400:kworker.0 Request processed in 24us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636923.543954:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788636923.543964:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788636923.543969:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226100480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.543994:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226100480:12345-0@lo:400:kworker.0 Request processed in 24us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636923.543999:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788636923.544099:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226099456:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.544113:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226100096:0@lo:400:kworker.0 00010000:00080000:1.0:1788636923.544127:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef019b3800 x1875521226100736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636923.544137:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226100736:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.544147:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788636923.544158:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226099968:0@lo:400:kworker.0 00010000:00080000:1.0:1788636923.544178:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef019b0e00 x1875521226100608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636923.544187:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226100608:0@lo:400:kworker.0 00002000:00080000:3.0:1788636923.544528:0:18713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788636923.544557:0:18713:0:(import.c:65:import_set_state_nolock()) ffff9cef03750000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636923.544613:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875521226099712:12345-0@lo:8:kworker.0 Request processed in 1562us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636923.544629:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636923.544644:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636923.544648:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3645:x1875521226100224:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788636923.544670:0:18713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:3.0:1788636923.544691:0:18713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5b741ef42e839763 00002000:00100000:3.0:1788636923.544701:0:18713:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9cef03753000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788636923.544705:0:18713:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788636923.544707:0:18713:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788636923.544751:0:18713:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788636923.544763:0:18713:0:(import.c:65:import_set_state_nolock()) ffff9cef03753800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636923.544791:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875521226100224:12345-0@lo:8:kworker.0 Request processed in 141us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636923.544796:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788636923.544833:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636923.544837:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636923.544840:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636923.544863:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef0237d180 x1875521226099840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636923.544874:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0237d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226099840:0@lo:400:kworker.0 00010000:00080000:3.0:1788636923.544885:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef019b1880 x1875521226100480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636923.544894:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226100480:0@lo:400:kworker.0 00000100:00100000:3.0:1788636923.544910:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226099584:0@lo:400:kworker.0 00010000:00080000:3.0:1788636923.544922:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef019b0380 x1875521226100352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636923.544936:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226100352:0@lo:400:kworker.0 00010000:00080000:3.0:1788636923.544949:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef019b0000 x1875521226100864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636923.544956:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226100864:0@lo:400:kworker.0 00000100:00100000:0.0:1788636923.545288:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226100992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636923.545336:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636923.545395:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226100992 00000100:00100000:3.0:1788636923.545402:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226100992 00000100:00100000:3.0:1788636923.545435:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788636923.545442:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226100992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636923.545464:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00010000:00080000:1.0:1788636923.545566:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf00f178e00 x1875521226099712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788636923.545579:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788636923.545597:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788636923.545602:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788636923.545605:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032424800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788636923.545625:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788636923.545630:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3645:1875521226099712:0@lo:8:kworker.0 00010000:00080000:1.0:1788636923.545644:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef019b1f80 x1875521226100224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788636923.545653:0:3645:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788636923.545658:0:3645:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788636923.545660:0:3645:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788636923.545662:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9cf032136000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788636923.545672:0:3645:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788636923.545675:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3645:1875521226100224:0@lo:8:kworker.0 00000004:00080000:1.0:1788636923.545718:0:17949:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788636923.545736:0:17949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875521226101248:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788636923.545762:0:17949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.545777:0:17949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf008571b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636923.545787:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636923.545801:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226101120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636923.545840:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636923.545857:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226101248 00000100:00100000:1.0:1788636923.545860:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226101248 00000100:00100000:1.0:1788636923.545890:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788636923.545897:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17949:x1875521226101248:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788636923.546229:0:17230:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788636923.546314:0:17230:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 592357506592ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788636923.546321:0:17230:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788636923.547928:0:17948:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788636923.548000:0:17948:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 592359192180ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788636923.548007:0:17948:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788636923.549105:0:17184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788636923.549231:0:17937:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788636923.554685:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226100992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9233us (9338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636923.554699:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788636923.554758:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226101120 00000100:00100000:3.0:1788636923.554770:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226101120 00000100:00100000:3.0:1788636923.554827:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636923.554837:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875521226101120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788636923.554868:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788636923.554941:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3649:x1875521226101120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (9101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636923.554948:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1788636923.555000:0:17231:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788636923.555021:0:17231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17231:1875521226101504:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788636923.555060:0:17231:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636923.555085:0:17231:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00568f240 going to sleep for 11 seconds 00000100:00080000:3.0:1788636923.555110:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636923.555127:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226101376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636923.555154:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788636923.555189:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf002490e00 x1875521226101120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636923.555211:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002490e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226101120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788636923.555239:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226101376 00000100:00100000:3.0:1788636923.555243:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226101376 00000100:00100000:3.0:1788636923.555641:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636923.555651:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226101376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636923.555664:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788636923.555699:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226101376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636923.555704:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788636923.555720:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788636923.555738:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03a9d6680 x1875521226101376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636923.555751:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226101376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636923.555777:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788636923.555784:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788636923.555903:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226101504 00000100:00100000:3.0:1788636923.555908:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226101504 00000100:00100000:3.0:1788636923.555998:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636923.556005:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17231:x1875521226101504:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788636923.559997:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226100992:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1788636923.561803:0:18712:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788636923.561829:0:18712:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788636923.561933:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17949:x1875521226101248:12345-0@lo:7:osp-pre-1-1.0 Request processed in 16032us (16165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636923.561947:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788636923.562008:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf002493b80 x1875521226101248/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788636939 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636923.562021:0:17949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002493b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875521226101248:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788636923.562034:0:17949:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788636923.562076:0:17949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875521226101632:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788636923.562111:0:17949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636923.562136:0:17949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00307f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636923.562152:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226101632 00000100:00100000:2.0:1788636923.562158:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226101632 00000100:00100000:2.0:1788636923.562197:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636923.562206:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17949:x1875521226101632:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788636923.562233:0:18713:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788636923.562265:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17949:x1875521226101632:12345-0@lo:5:osp-pre-1-1.0 Request processed in 60us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636923.562271:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788636923.562295:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bc000 x1875521226101632/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636939 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636923.562305:0:17949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875521226101632:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788636923.562314:0:17949:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788636923.562349:0:17949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875521226101760:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788636923.562370:0:17949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636923.562384:0:17949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00307f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636923.562395:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226101760 00000100:00100000:2.0:1788636923.562398:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226101760 00000100:00100000:2.0:1788636923.562418:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788636923.562424:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17949:x1875521226101760:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788636923.562451:0:18714:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:3.0:1788636923.565068:0:19786:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788636923.565081:0:19786:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788636923.565094:0:19786:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:3.0:1788636923.580898:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.580911:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aa643d4/0x5b741ef42e83976a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.580928:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.580933:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.580939:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aa643d4/0x5b741ef42e83976a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.580956:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aa643d4/0x5b741ef42e83976a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.580968:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aa643d4/0x5b741ef42e83976a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.580977:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007aa643d4/0x5b741ef42e83976a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.580994:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636923.581449:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.581456:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069b8ca50/0x5b741ef42e839771 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.581466:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.581470:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.581474:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069b8ca50/0x5b741ef42e839771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.581503:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069b8ca50/0x5b741ef42e839771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.581513:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069b8ca50/0x5b741ef42e839771 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.581521:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069b8ca50/0x5b741ef42e839771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.581536:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788636923.581943:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.581949:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e839778 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.581956:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.581959:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.581963:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e839778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.581971:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e839778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.581979:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e839778 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.581996:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e839778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.582011:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788636923.582435:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.582442:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e83977f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.582451:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.582453:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.582457:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e83977f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.582467:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e83977f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.582475:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e83977f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.582482:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e83977f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.582500:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788636923.583210:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788636923.583219:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5bea082/0x5b741ef42e839786 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.583229:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788636923.583232:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636923.583236:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5bea082/0x5b741ef42e839786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.583246:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5bea082/0x5b741ef42e839786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.583255:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5bea082/0x5b741ef42e839786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.583262:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5bea082/0x5b741ef42e839786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.583284:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788636923.584345:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788636923.584354:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e83978d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.584367:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788636923.584370:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636923.584375:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e83978d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.584386:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e83978d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.584395:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e83978d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.584403:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e83978d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.584413:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788636923.586068:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788636923.586078:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000422ab205/0x5b741ef42e839794 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.586095:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788636923.586099:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636923.586106:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000422ab205/0x5b741ef42e839794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.586133:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000422ab205/0x5b741ef42e839794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.586145:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000422ab205/0x5b741ef42e839794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.586152:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000422ab205/0x5b741ef42e839794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.586163:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1788636923.587149:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788636923.587158:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007aa643d4/0x5b741ef42e83976a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587170:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95e00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.587175:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007aa643d4/0x5b741ef42e83976a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587187:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007aa643d4/0x5b741ef42e83976a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587211:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007aa643d4/0x5b741ef42e83976a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587220:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aa643d4/0x5b741ef42e83976a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587253:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788636923.587257:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069b8ca50/0x5b741ef42e839771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587264:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.587267:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069b8ca50/0x5b741ef42e839771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587275:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069b8ca50/0x5b741ef42e839771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587285:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069b8ca50/0x5b741ef42e839771 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587292:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069b8ca50/0x5b741ef42e839771 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587304:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788636923.587308:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e839778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587315:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.587319:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e839778 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587336:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e839778 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587346:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e839778 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587354:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e839778 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587367:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788636923.587370:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e83977f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587377:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.587381:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e83977f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587389:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e83977f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587397:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e83977f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587405:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e83977f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587426:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788636923.587431:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5bea082/0x5b741ef42e839786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587437:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.587440:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5bea082/0x5b741ef42e839786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587448:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5bea082/0x5b741ef42e839786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587459:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5bea082/0x5b741ef42e839786 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587467:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5bea082/0x5b741ef42e839786 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587479:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636923.587482:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e83978d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587501:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.587505:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e83978d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587525:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e83978d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587536:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e83978d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587544:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d29b0256/0x5b741ef42e83978d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587559:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636923.587563:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000422ab205/0x5b741ef42e839794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587570:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.587573:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000422ab205/0x5b741ef42e839794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587580:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000422ab205/0x5b741ef42e839794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587589:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000422ab205/0x5b741ef42e839794 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587603:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000422ab205/0x5b741ef42e839794 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.587626:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.587628:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.587630:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.587637:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.587643:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636923.588264:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788636923.588275:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83979b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.588292:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788636923.588298:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636923.588305:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83979b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.588318:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83979b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.588329:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83979b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.588349:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83979b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.588370:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636923.588558:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636923.588566:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83979b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.588574:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.588579:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83979b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.588587:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83979b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.588607:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83979b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.588615:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce76106f/0x5b741ef42e83979b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.588632:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.588634:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.588635:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636923.589169:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788636923.589176:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c94faa11/0x5b741ef42e8397a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.589187:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788636923.589191:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636923.589196:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c94faa11/0x5b741ef42e8397a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.589207:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c94faa11/0x5b741ef42e8397a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.589216:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c94faa11/0x5b741ef42e8397a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.589224:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c94faa11/0x5b741ef42e8397a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.589242:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636923.589595:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636923.589610:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c94faa11/0x5b741ef42e8397a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.589619:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab0000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.589624:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c94faa11/0x5b741ef42e8397a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.589633:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c94faa11/0x5b741ef42e8397a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.589647:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c94faa11/0x5b741ef42e8397a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.589654:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c94faa11/0x5b741ef42e8397a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.589669:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.589671:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.589673:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636923.590324:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788636923.590332:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000192b3d0f/0x5b741ef42e8397a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.590350:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1788636923.590355:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636923.590361:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000192b3d0f/0x5b741ef42e8397a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.590372:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000192b3d0f/0x5b741ef42e8397a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.590382:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000192b3d0f/0x5b741ef42e8397a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.590390:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000192b3d0f/0x5b741ef42e8397a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.590407:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636923.590868:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636923.590876:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000192b3d0f/0x5b741ef42e8397a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.590885:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03aab1000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.590890:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000192b3d0f/0x5b741ef42e8397a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.590912:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000192b3d0f/0x5b741ef42e8397a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.590926:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000192b3d0f/0x5b741ef42e8397a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.590934:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000192b3d0f/0x5b741ef42e8397a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.590953:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.590955:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.590956:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636923.596846:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.596861:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b63dc57/0x5b741ef42e8397b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.596885:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.596890:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.596897:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b63dc57/0x5b741ef42e8397b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.596914:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b63dc57/0x5b741ef42e8397b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.596926:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b63dc57/0x5b741ef42e8397b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.596934:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b63dc57/0x5b741ef42e8397b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.596961:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636923.598743:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.598757:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bef0a90/0x5b741ef42e8397b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.598776:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.598781:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.598788:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bef0a90/0x5b741ef42e8397b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.598801:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bef0a90/0x5b741ef42e8397b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.598849:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bef0a90/0x5b741ef42e8397b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.598858:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bef0a90/0x5b741ef42e8397b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.598878:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788636923.599186:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636923.599194:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b63dc57/0x5b741ef42e8397b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.599203:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94e00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.599208:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b63dc57/0x5b741ef42e8397b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.599218:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b63dc57/0x5b741ef42e8397b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.599235:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b63dc57/0x5b741ef42e8397b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.599255:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b63dc57/0x5b741ef42e8397b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.599289:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636923.599293:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bef0a90/0x5b741ef42e8397b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.599299:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.599302:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bef0a90/0x5b741ef42e8397b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.599308:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bef0a90/0x5b741ef42e8397b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.599318:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bef0a90/0x5b741ef42e8397b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.599325:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bef0a90/0x5b741ef42e8397b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.599337:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.599339:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.599341:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788636923.600111:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788636923.600133:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788636923.600146:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788636923.600313:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17949:x1875521226101760:12345-0@lo:5:osp-pre-1-1.0 Request processed in 37883us (37936us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788636923.600325:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1788636923.600430:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636923.600470:0:17949:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788636923.600480:0:17949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17949:1875521226101760:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788636923.600509:0:17949:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788636923.600570:0:17949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17949:1875521226101888:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788636923.600624:0:17949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636923.600655:0:17949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00307f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636923.600673:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226101888 00000100:00100000:2.0:1788636923.600679:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226101888 00000100:00100000:2.0:1788636923.600734:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788636923.600752:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17949:x1875521226101888:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788636923.600800:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17949:x1875521226101888:12345-0@lo:900:osp-pre-1-1.0 Request processed in 49us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636923.600830:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788636923.600868:0:17949:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bc000 x1875521226101888/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788636939 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636923.600880:0:17949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17949:1875521226101888:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1788636923.601571:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.601581:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e21b2932/0x5b741ef42e8397be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.601660:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.601665:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.601672:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e21b2932/0x5b741ef42e8397be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.601688:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e21b2932/0x5b741ef42e8397be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.601699:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e21b2932/0x5b741ef42e8397be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.601707:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e21b2932/0x5b741ef42e8397be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.601749:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636923.602219:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.602226:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a667f62b/0x5b741ef42e8397c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.602237:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.602240:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.602245:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a667f62b/0x5b741ef42e8397c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.602256:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a667f62b/0x5b741ef42e8397c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.602266:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a667f62b/0x5b741ef42e8397c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.602275:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a667f62b/0x5b741ef42e8397c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.602374:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788636923.606881:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.606895:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecfcab97/0x5b741ef42e8397cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.606913:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.606925:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.606931:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecfcab97/0x5b741ef42e8397cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.606947:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecfcab97/0x5b741ef42e8397cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.606958:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecfcab97/0x5b741ef42e8397cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.606966:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecfcab97/0x5b741ef42e8397cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607030:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788636923.607040:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e21b2932/0x5b741ef42e8397be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607049:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.607053:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e21b2932/0x5b741ef42e8397be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607062:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e21b2932/0x5b741ef42e8397be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607081:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e21b2932/0x5b741ef42e8397be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607090:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e21b2932/0x5b741ef42e8397be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607115:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636923.607119:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a667f62b/0x5b741ef42e8397c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607124:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.607127:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a667f62b/0x5b741ef42e8397c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607142:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a667f62b/0x5b741ef42e8397c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607152:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a667f62b/0x5b741ef42e8397c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607160:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a667f62b/0x5b741ef42e8397c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607174:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636923.607178:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecfcab97/0x5b741ef42e8397cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607185:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.607188:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecfcab97/0x5b741ef42e8397cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607196:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecfcab97/0x5b741ef42e8397cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607206:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecfcab97/0x5b741ef42e8397cc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.607213:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.607215:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.607222:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.607368:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636923.607460:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788636923.607465:0:19786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecfcab97/0x5b741ef42e8397cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.607932:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636923.608050:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.608056:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e8397d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.608065:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.608068:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.608074:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e8397d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.608083:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e8397d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.608098:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e8397d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.608105:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e8397d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.608131:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636923.608378:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636923.608385:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e8397d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.608395:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94000 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.608399:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e8397d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.608408:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e8397d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.608424:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e8397d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.608432:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e8397d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.608462:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.608464:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.608466:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636923.608549:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.608555:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cf430b3/0x5b741ef42e8397da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.608564:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.608568:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.608572:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cf430b3/0x5b741ef42e8397da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.608583:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cf430b3/0x5b741ef42e8397da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.608603:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cf430b3/0x5b741ef42e8397da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.608611:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cf430b3/0x5b741ef42e8397da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.608639:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636923.608743:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636923.608749:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cf430b3/0x5b741ef42e8397da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.608757:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.608761:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cf430b3/0x5b741ef42e8397da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.608769:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cf430b3/0x5b741ef42e8397da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.608781:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cf430b3/0x5b741ef42e8397da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.608789:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cf430b3/0x5b741ef42e8397da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.608833:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.608836:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.608838:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636923.609276:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.609284:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e8397e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.609294:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.609297:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.609302:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e8397e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.609312:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e8397e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.609321:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e8397e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.609329:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e8397e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.609349:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636923.609472:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636923.609478:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e8397e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.609508:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.609512:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e8397e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.609521:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e8397e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.609533:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e8397e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.609542:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e8397e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.609557:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.609559:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.609561:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636923.609776:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.609782:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ec9704/0x5b741ef42e8397e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.609790:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.609799:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.609803:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071ec9704/0x5b741ef42e8397e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.609841:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071ec9704/0x5b741ef42e8397e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.609851:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ec9704/0x5b741ef42e8397e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.609859:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071ec9704/0x5b741ef42e8397e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.609876:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636923.610114:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636923.610121:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071ec9704/0x5b741ef42e8397e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.610128:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.610131:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ec9704/0x5b741ef42e8397e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.610140:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ec9704/0x5b741ef42e8397e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.610159:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071ec9704/0x5b741ef42e8397e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.610167:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071ec9704/0x5b741ef42e8397e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.610181:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.610183:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.610185:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636923.610253:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.610259:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bca58ae9/0x5b741ef42e8397ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.610268:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.610271:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.610275:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bca58ae9/0x5b741ef42e8397ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.610284:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bca58ae9/0x5b741ef42e8397ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.610293:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bca58ae9/0x5b741ef42e8397ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.610306:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bca58ae9/0x5b741ef42e8397ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.610357:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636923.610859:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.610866:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e8397f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.610875:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.610878:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.610883:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e8397f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.610892:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e8397f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.610901:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e8397f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.610908:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e8397f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.614763:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788636923.614779:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bca58ae9/0x5b741ef42e8397ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.614794:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.614800:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bca58ae9/0x5b741ef42e8397ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.614835:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bca58ae9/0x5b741ef42e8397ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.614857:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bca58ae9/0x5b741ef42e8397ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.614866:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bca58ae9/0x5b741ef42e8397ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.614909:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636923.614914:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e8397f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.614921:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.614924:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e8397f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.614931:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e8397f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.614940:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e8397f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.614947:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.614949:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.614951:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636923.615161:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788636923.615168:0:19786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000407b2f/0x5b741ef42e8397f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788636923.615716:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788636923.615723:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e8397fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.615736:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=592s v=(0 0) 00010000:00010000:3.0:1788636923.615740:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636923.615745:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e8397fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.615757:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e8397fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.615765:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e8397fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.615772:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e8397fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636923.615907:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636923.623143:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636923.623158:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e8397fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.623171:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:1.0:1788636923.623176:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e8397fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.623187:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e8397fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.623211:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e8397fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.623220:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010490ae3/0x5b741ef42e8397fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636923.623252:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.623254:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636923.623256:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.623328:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788636923.623538:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788636923.623547:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d147e8/0x5b741ef42e839804 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.623560:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1788636923.623565:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636923.623572:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090d147e8/0x5b741ef42e839804 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.623587:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090d147e8/0x5b741ef42e839804 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.623667:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090d147e8/0x5b741ef42e839804 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.623676:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090d147e8/0x5b741ef42e839804 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.623734:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788636923.624310:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788636923.624317:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056fae44e/0x5b741ef42e83980b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.624325:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1788636923.624329:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636923.624339:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056fae44e/0x5b741ef42e83980b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.624349:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056fae44e/0x5b741ef42e83980b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.624358:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056fae44e/0x5b741ef42e83980b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.624365:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056fae44e/0x5b741ef42e83980b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.629656:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788636923.629670:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090d147e8/0x5b741ef42e839804 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.629686:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6400 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.629692:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d147e8/0x5b741ef42e839804 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.629722:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090d147e8/0x5b741ef42e839804 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.629750:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090d147e8/0x5b741ef42e839804 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.629761:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090d147e8/0x5b741ef42e839804 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.629794:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636923.629798:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056fae44e/0x5b741ef42e83980b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.629827:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.629830:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056fae44e/0x5b741ef42e83980b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.629839:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056fae44e/0x5b741ef42e83980b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.629850:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056fae44e/0x5b741ef42e83980b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.629859:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.629861:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.629868:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636923.630015:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788636923.630023:0:19786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056fae44e/0x5b741ef42e83980b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.630460:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788636923.630756:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788636923.630765:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a0f86c/0x5b741ef42e839812 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.630779:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1788636923.630784:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636923.630792:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a0f86c/0x5b741ef42e839812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.630835:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2a0f86c/0x5b741ef42e839812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.630859:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2a0f86c/0x5b741ef42e839812 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.630867:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a0f86c/0x5b741ef42e839812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.630885:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636923.631702:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636923.631714:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2a0f86c/0x5b741ef42e839812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.631728:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c7c00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.631733:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a0f86c/0x5b741ef42e839812 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.631744:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a0f86c/0x5b741ef42e839812 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.631766:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2a0f86c/0x5b741ef42e839812 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.631775:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2a0f86c/0x5b741ef42e839812 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.631800:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.631802:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.631821:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788636923.631960:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788636923.631967:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9d97a45/0x5b741ef42e839819 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.631978:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1788636923.631982:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636923.631987:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d97a45/0x5b741ef42e839819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.631998:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9d97a45/0x5b741ef42e839819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.632008:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9d97a45/0x5b741ef42e839819 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.632016:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9d97a45/0x5b741ef42e839819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.632048:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636923.632567:0:17193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636923.632574:0:17193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9d97a45/0x5b741ef42e839819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.632583:0:17193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0113c6600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.632646:0:17193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9d97a45/0x5b741ef42e839819 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.632664:0:17193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9d97a45/0x5b741ef42e839819 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.632681:0:17193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9d97a45/0x5b741ef42e839819 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.632688:0:17193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9d97a45/0x5b741ef42e839819 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.632706:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.632708:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.632710:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788636923.633852:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788636923.633866:0:19786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028fc7053/0x5b741ef42e839820 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.633884:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1788636923.633889:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636923.633898:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028fc7053/0x5b741ef42e839820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.633913:0:19786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028fc7053/0x5b741ef42e839820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.633924:0:19786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028fc7053/0x5b741ef42e839820 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.633934:0:19786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028fc7053/0x5b741ef42e839820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636923.633961:0:19786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788636923.634050:0:19786:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1788636923.634177:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17231:x1875521226101504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 78167us (79111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636923.634190:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788636923.634294:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636923.634301:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028fc7053/0x5b741ef42e839820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.634310:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0013a0200 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636923.634315:0:19295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028fc7053/0x5b741ef42e839820 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.634325:0:19295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028fc7053/0x5b741ef42e839820 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.634345:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028fc7053/0x5b741ef42e839820 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.634369:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028fc7053/0x5b741ef42e839820 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636923.634393:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.634395:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636923.634397:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636923.634506:0:17231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17231:1875521226101504:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788636923.634526:0:17231:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788636923.634581:0:17231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17231:1875521226102016:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788636923.634702:0:17231:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636923.634734:0:17231:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf009496000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636923.634791:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226102016 00000100:00100000:2.0:1788636923.634798:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226102016 00000100:00100000:2.0:1788636923.634878:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788636923.634889:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17231:x1875521226102016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788636923.634933:0:18712:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1788636923.645202:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17231:x1875521226102016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10304us (10490us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788636923.645220:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788636923.647181:0:17231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17231:1875521226102016:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788636923.647208:0:17231:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1788636924.118413:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636924.565967:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226102144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636924.566061:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636924.566133:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226102144 00000100:00100000:0.0:1788636924.566143:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226102144 00000100:00100000:0.0:1788636924.566200:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636924.566212:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226102144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788636924.566239:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788636924.566292:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226102144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636924.566300:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636924.566364:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226102144:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788636925.143607:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788636925.423689:0:19882:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg226-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788636925.592678:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226102272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636925.592776:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636925.592871:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226102272 00000100:00100000:0.0:1788636925.592880:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226102272 00000100:00100000:0.0:1788636925.592939:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788636925.592949:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226102272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636925.592987:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788636925.593032:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226102272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636925.593039:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788636925.593086:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef03656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226102272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636925.593241:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636925.593250:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226102400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636925.593296:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636925.593630:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226102400 00000100:00100000:1.0:1788636925.593636:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226102400 00000100:00100000:1.0:1788636925.593674:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788636925.593695:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226102400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636925.593720:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788636925.593762:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226102400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636925.593769:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788636925.593803:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226102400:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788636926.165109:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788636926.337518:0:19935:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788636926.337829:0:19935:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788636926.743336:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788636927.190333:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788636927.287798:0:19985:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788636927.292522:0:19985:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788636927.743066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636927.743175:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207130752 00000100:00100000:0.0:1788636927.743189:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207130752 00000100:00100000:0.0:1788636927.743247:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 115 00000100:00100000:0.0:1788636927.743256:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1875521207130752:12345-192.168.202.26@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788636927.743320:0:17196:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 001b69e6-bbb8-4ee3-8ad9-a4904af6f901@192.168.202.26@tcp t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:0.0:1788636927.743359:0:17196:0:(genops.c:1385:class_connect()) connect: client 001b69e6-bbb8-4ee3-8ad9-a4904af6f901, cookie 0x5b741ef42e839827 00000100:00080000:0.0:1788636927.743536:0:17196:0:(import.c:65:import_set_state_nolock()) ffff9cef04043000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636927.743621:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+5:2397:x1875521207130752:12345-192.168.202.26@tcp:250:mount.lustre.0 Request processed in 364us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636927.743630:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 115 00000100:00100000:3.0:1788636927.747129:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636927.747914:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207130880 00000100:00100000:0.0:1788636927.747926:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207130880 00000100:00100000:0.0:1788636927.748051:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 116 00000100:00100000:0.0:1788636927.748062:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+5:14915:x1875521207130880:12345-192.168.202.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636927.748078:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636927.748093:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0013a1800/0x5b741ef42e83982e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3938e expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636927.748120:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0013a1800/0x5b741ef42e83982e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3938e expref: 6 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636927.748131:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0013a1800/0x5b741ef42e83982e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3938e expref: 6 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636927.748140:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0013a1800, rc 0) 00000100:00100000:0.0:1788636927.748223:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+6:14915:x1875521207130880:12345-192.168.202.26@tcp:101:mount.lustre.0 Request processed in 162us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636927.748230:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 116 00000100:00100000:3.0:1788636927.756105:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636927.756313:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207131008 00000100:00100000:1.0:1788636927.756328:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207131008 00000100:00100000:1.0:1788636927.756398:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 117 00000100:00100000:1.0:1788636927.756411:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+6:14915:x1875521207131008:12345-192.168.202.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788636927.756585:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+6:14915:x1875521207131008:12345-192.168.202.26@tcp:501:mount.lustre.0 Request processed in 177us (494us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788636927.756594:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 117 00000100:00100000:3.0:1788636927.760910:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636927.761689:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207131136 00000100:00100000:0.0:1788636927.761699:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207131136 00000100:00100000:0.0:1788636927.761758:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 118 00000100:00100000:0.0:1788636927.761780:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+6:14915:x1875521207131136:12345-192.168.202.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636927.761796:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636927.761836:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0013a0200/0x5b741ef42e839835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39395 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636927.761865:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0013a0200/0x5b741ef42e839835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39395 expref: 7 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636927.761876:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0013a0200/0x5b741ef42e839835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39395 expref: 7 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636927.761886:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0013a0200, rc 0) 00000100:00100000:0.0:1788636927.761989:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+7:14915:x1875521207131136:12345-192.168.202.26@tcp:101:mount.lustre.0 Request processed in 210us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636927.761996:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 118 00000100:00100000:3.0:1788636927.778915:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636927.779046:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207131264 00000100:00100000:2.0:1788636927.779057:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207131264 00000100:00100000:2.0:1788636927.779122:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 119 00000100:00100000:2.0:1788636927.779132:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+7:14915:x1875521207131264:12345-192.168.202.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788636927.779733:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+8:14915:x1875521207131264:12345-192.168.202.26@tcp:501:mount.lustre.0 Request processed in 600us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636927.779741:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 119 00000100:00100000:3.0:1788636927.790953:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636927.791235:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207131392 00000100:00100000:1.0:1788636927.791248:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207131392 00000100:00100000:1.0:1788636927.791321:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 120 00000100:00100000:1.0:1788636927.791332:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+8:14915:x1875521207131392:12345-192.168.202.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788636927.791492:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+8:14915:x1875521207131392:12345-192.168.202.26@tcp:503:mount.lustre.0 Request processed in 161us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636927.791500:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 120 00000100:00100000:3.0:1788636927.796366:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636927.796738:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207131520 00000100:00100000:2.0:1788636927.796752:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207131520 00000100:00100000:2.0:1788636927.796939:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 121 00000100:00100000:2.0:1788636927.796966:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+8:14933:x1875521207131520:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788636927.797242:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+8:14933:x1875521207131520:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 278us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636927.797251:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 121 00000100:00100000:3.0:1788636927.858732:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636927.858958:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207131648 00000100:00100000:0.0:1788636927.858969:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207131648 00000100:00100000:0.0:1788636927.859024:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 122 00000100:00100000:0.0:1788636927.859034:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+8:14933:x1875521207131648:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636927.859190:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+8:14933:x1875521207131648:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 156us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636927.859198:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 122 00000100:00100000:2.0:1788636927.874645:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636927.874948:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207131776 00000100:00100000:0.0:1788636927.874959:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207131776 00000100:00100000:0.0:1788636927.875014:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 123 00000100:00100000:0.0:1788636927.875024:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+8:14933:x1875521207131776:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636927.875164:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+8:14933:x1875521207131776:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 141us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636927.875172:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 123 00000100:00100000:3.0:1788636927.896996:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636927.904749:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207131904 00000100:00100000:1.0:1788636927.904768:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207131904 00000100:00100000:1.0:1788636927.905380:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 124 00000100:00100000:1.0:1788636927.905392:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+8:14915:x1875521207131904:12345-192.168.202.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788636927.905411:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636927.905430:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e83983c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef393c6 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636927.905461:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e83983c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393c6 expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636927.905482:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab37800/0x5b741ef42e83983c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393c6 expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636927.905492:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37800, rc 0) 00000100:00100000:1.0:1788636927.905642:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+9:14915:x1875521207131904:12345-192.168.202.26@tcp:101:mount.lustre.0 Request processed in 252us (10391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636927.905650:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 124 00000100:00100000:3.0:1788636927.920009:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636927.920153:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207132032 00000100:00100000:2.0:1788636927.920162:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207132032 00000100:00100000:2.0:1788636927.920209:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 125 00000100:00100000:2.0:1788636927.920216:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+9:14915:x1875521207132032:12345-192.168.202.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788636927.920237:0:17198:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788636927.920257:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788636927.920260:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788636927.920262:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788636927.920264:0:17198:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788636927.920266:0:17198:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788636927.922848:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+9:14915:x1875521207132032:12345-192.168.202.26@tcp:256:mount.lustre.0 Request processed in 2622us (2836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636927.922861:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 125 00000100:00100000:2.0:1788636927.929340:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636927.929489:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207132160 00000100:00100000:1.0:1788636927.929501:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207132160 00000100:00100000:1.0:1788636927.929561:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 126 00000100:00100000:1.0:1788636927.929580:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+9:14915:x1875521207132160:12345-192.168.202.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788636927.929598:0:17196:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636927.929616:0:17196:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab37a00/0x5b741ef42e839843 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef393cd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636927.929643:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab37a00/0x5b741ef42e839843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393cd expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636927.929669:0:17196:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab37a00/0x5b741ef42e839843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393cd expref: 10 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636927.929678:0:17196:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37a00, rc 0) 00000100:00100000:1.0:1788636927.929735:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+10:14915:x1875521207132160:12345-192.168.202.26@tcp:101:mount.lustre.0 Request processed in 165us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636927.929741:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 126 00000100:00100000:2.0:1788636927.939790:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636927.940073:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207132288 00000100:00100000:1.0:1788636927.940083:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207132288 00000100:00100000:1.0:1788636927.940139:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 127 00000100:00100000:1.0:1788636927.940149:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fc77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+10:14915:x1875521207132288:12345-192.168.202.26@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788636927.940308:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fc77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+10:14915:x1875521207132288:12345-192.168.202.26@tcp:501:mount.lustre.0 Request processed in 159us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636927.940316:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 127 00000100:00100000:3.0:1788636927.948087:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636927.948266:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207132416 00000100:00100000:2.0:1788636927.948277:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207132416 00000100:00100000:2.0:1788636927.948336:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 128 00000100:00100000:2.0:1788636927.948346:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+10:14915:x1875521207132416:12345-192.168.202.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788636927.948512:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+10:14915:x1875521207132416:12345-192.168.202.26@tcp:503:mount.lustre.0 Request processed in 166us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636927.948520:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 128 00000100:00100000:2.0:1788636927.953676:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636927.957622:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207132544 00000100:00100000:0.0:1788636927.957637:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207132544 00000100:00100000:0.0:1788636927.957714:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 129 00000100:00100000:0.0:1788636927.957724:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+10:14937:x1875521207132544:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636927.957934:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+10:14937:x1875521207132544:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 210us (4267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636927.957943:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 129 00000100:00100000:3.0:1788636927.964519:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636927.964845:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207132672 00000100:00100000:1.0:1788636927.964856:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207132672 00000100:00100000:1.0:1788636927.964973:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 130 00000100:00100000:1.0:1788636927.964985:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03b19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+10:14937:x1875521207132672:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788636927.965149:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03b19a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+10:14937:x1875521207132672:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 166us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636927.965158:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 130 00000100:00100000:3.0:1788636927.979713:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636927.980206:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207132800 00000100:00100000:2.0:1788636927.980240:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207132800 00000100:00100000:2.0:1788636927.980293:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:2.0:1788636927.980302:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2397:x1875521207132800:12345-192.168.202.26@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788636927.980332:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 118080cd-cdb0-45eb-bbf8-8278fafb5be9@192.168.202.26@tcp t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:2.0:1788636927.980378:0:17206:0:(genops.c:1385:class_connect()) connect: client 118080cd-cdb0-45eb-bbf8-8278fafb5be9, cookie 0x5b741ef42e83984a 00000004:00100000:2.0:1788636927.980401:0:17206:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788636927.980644:0:17206:0:(import.c:65:import_set_state_nolock()) ffff9cef030fc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636927.981031:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2397:x1875521207132800:12345-192.168.202.26@tcp:38:mount.lustre.0 Request processed in 726us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636927.981039:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:2.0:1788636927.992528:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636927.992630:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207133056 00000100:00100000:1.0:1788636927.992641:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207133056 00000100:00100000:1.0:1788636927.992695:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 8 00000100:00100000:1.0:1788636927.992704:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875521207133056:12345-192.168.202.26@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788636927.992760:0:17204:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 118080cd-cdb0-45eb-bbf8-8278fafb5be9@192.168.202.26@tcp t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:1.0:1788636927.993039:0:17204:0:(genops.c:1385:class_connect()) connect: client 118080cd-cdb0-45eb-bbf8-8278fafb5be9, cookie 0x5b741ef42e839851 00000004:00100000:1.0:1788636927.993064:0:17204:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788636927.993288:0:17204:0:(import.c:65:import_set_state_nolock()) ffff9cef0275e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636927.993365:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2397:x1875521207133056:12345-192.168.202.26@tcp:38:mount.lustre.0 Request processed in 660us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636927.993373:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 8 00000100:00100000:3.0:1788636927.999733:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636927.999776:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636927.999858:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207132928 00000100:00100000:2.0:1788636927.999869:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207132928 00000100:00080000:3.0:1788636927.999921:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636927.999939:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207133312 00000100:00100000:2.0:1788636927.999943:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207133312 00000100:00100000:3.0:1788636927.999951:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 9 00000100:00100000:3.0:1788636927.999962:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:0:x1875521207132928:12345-192.168.202.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788636928.000006:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788636928.000087:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:0:x1875521207132928:12345-192.168.202.26@tcp:41:mount.lustre.0 Request processed in 127us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636928.007258:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 9 00000100:00100000:3.0:1788636928.007321:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:3.0:1788636928.007337:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:14915:x1875521207133312:12345-192.168.202.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788636928.007379:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788636928.007493:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:14915:x1875521207133312:12345-192.168.202.26@tcp:41:mount.lustre.0 Request processed in 162us (7714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636928.007500:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:0.0:1788636928.007677:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636928.007951:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207133184 00000100:00100000:1.0:1788636928.007959:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207133184 00000100:00100000:1.0:1788636928.008013:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:1.0:1788636928.008021:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:0:x1875521207133184:12345-192.168.202.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788636928.008044:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788636928.008110:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:0:x1875521207133184:12345-192.168.202.26@tcp:41:mount.lustre.0 Request processed in 89us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636928.008118:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00080000:3.0:1788636928.008503:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636928.010423:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636928.010537:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207133440 00000100:00100000:3.0:1788636928.010548:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207133440 00000100:00100000:3.0:1788636928.010602:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:3.0:1788636928.010614:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:14915:x1875521207133440:12345-192.168.202.26@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788636928.010700:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:14915:x1875521207133440:12345-192.168.202.26@tcp:40:mount.lustre.0 Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636928.010707:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:0.0:1788636928.024983:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636928.025030:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636928.028751:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207133568 00000100:00100000:3.0:1788636928.028766:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207133568 00000100:00100000:3.0:1788636928.029121:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207133696 00000100:00100000:3.0:1788636928.029126:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207133696 00000100:00100000:3.0:1788636928.029258:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:3.0:1788636928.029268:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875521207133568:12345-192.168.202.26@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788636928.029318:0:19786:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 118080cd-cdb0-45eb-bbf8-8278fafb5be9@192.168.202.26@tcp t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:3.0:1788636928.029358:0:19786:0:(genops.c:1385:class_connect()) connect: client 118080cd-cdb0-45eb-bbf8-8278fafb5be9, cookie 0x5b741ef42e839858 00002000:00100000:3.0:1788636928.029372:0:19786:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 118080cd-cdb0-45eb-bbf8-8278fafb5be9/ffff9cef034cf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788636928.029414:0:19786:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788636928.029635:0:19786:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788636928.029669:0:19786:0:(import.c:65:import_set_state_nolock()) ffff9cef034c8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636928.029757:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2397:x1875521207133568:12345-192.168.202.26@tcp:8:mount.lustre.0 Request processed in 487us (4782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636928.031670:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:0.0:1788636928.031684:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875521207133696:12345-192.168.202.26@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788636928.031724:0:18712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 118080cd-cdb0-45eb-bbf8-8278fafb5be9@192.168.202.26@tcp t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:0.0:1788636928.031759:0:18712:0:(genops.c:1385:class_connect()) connect: client 118080cd-cdb0-45eb-bbf8-8278fafb5be9, cookie 0x5b741ef42e83985f 00002000:00100000:0.0:1788636928.031771:0:18712:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 118080cd-cdb0-45eb-bbf8-8278fafb5be9/ffff9cef04046800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788636928.031790:0:18712:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788636928.032662:0:18712:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788636928.032698:0:18712:0:(import.c:65:import_set_state_nolock()) ffff9cef04043800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636928.032757:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2397:x1875521207133696:12345-192.168.202.26@tcp:8:mount.lustre.0 Request processed in 1073us (7724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636928.032781:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:3.0:1788636928.033092:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:3.0:1788636928.033788:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636928.033850:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207133824 00000100:00100000:3.0:1788636928.033859:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207133824 00000100:00100000:3.0:1788636928.033904:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:3.0:1788636928.033916:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:14915:x1875521207133824:12345-192.168.202.26@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788636928.033966:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:14915:x1875521207133824:12345-192.168.202.26@tcp:900:mount.lustre.0 Request processed in 54us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636928.033973:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:0.0:1788636928.041479:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636928.041597:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207133952 00000100:00100000:2.0:1788636928.041617:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207133952 00000100:00100000:2.0:1788636928.041679:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 0 00000100:00100000:2.0:1788636928.041690:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:14915:x1875521207133952:12345-192.168.202.26@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788636928.045779:0:17207:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3987us 00000004:00200000:2.0:1788636928.085959:0:17207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788636928.086081:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:14915:x1875521207133952:12345-192.168.202.26@tcp:33:mount.lustre.0 Request processed in 44388us (44621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.086093:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 0 00010000:00010000:2.0:1788636928.214492:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636928.467306:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636928.467416:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207134080 00000100:00100000:2.0:1788636928.467429:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207134080 00000100:00100000:2.0:1788636928.467539:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:2.0:1788636928.467550:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:14960:x1875521207134080:12345-192.168.202.26@tcp:101:mkdir.0 00010000:00010000:2.0:1788636928.467586:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636928.467614:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0000/0x5b741ef42e839866 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef393fe expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636928.467681:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83986d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636928.467695:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83986d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636928.467708:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83986d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636928.467769:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788636928.467772:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636928.467847:0:17205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83986d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636928.467874:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab0000/0x5b741ef42e839866 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393fe expref: 8 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636928.468097:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83986d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393fe expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636928.468107:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ec200) 00010000:00010000:2.0:1788636928.468180:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636928.468185:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1000, rc 0) 00000100:00100000:2.0:1788636928.468306:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:14960:x1875521207134080:12345-192.168.202.26@tcp:101:mkdir.0 Request processed in 757us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.468313:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:2.0:1788636928.661307:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226102656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636928.661396:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636928.661545:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226102656 00000100:00100000:1.0:1788636928.661554:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226102656 00000100:00100000:1.0:1788636928.661627:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636928.661639:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226102656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636928.661663:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788636928.661715:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1875521226102656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636928.661722:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636928.661776:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226102656:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788636928.661927:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636928.662036:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636928.662048:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226102528:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636928.662082:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636928.662108:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226102528 00000100:00100000:0.0:1788636928.662112:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226102528 00000100:00100000:0.0:1788636928.662138:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636928.662144:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226102528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788636928.662155:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788636928.662182:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226102528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636928.662188:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788636928.662203:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636928.662224:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226102528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788636928.662647:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226102784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636928.662680:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.662707:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226103296:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.662732:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.662747:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521226103808:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.662792:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.662841:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788636928.662846:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226103168:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.662871:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.662889:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226103680:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.662905:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.662916:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226104192:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.662932:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.662946:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226102912:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.662969:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.662985:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226103424:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663006:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.663019:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226103936:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663035:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.663044:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788636928.663049:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226103040:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.663089:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226103552:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663104:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.663116:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226104064:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663134:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636928.663152:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226102912 00000100:00100000:2.0:1788636928.663158:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226102912 00000100:00100000:2.0:1788636928.663197:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788636928.663204:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:3648:x1875521226102912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663239:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:3648:x1875521226102912:12345-0@lo:400:kworker.0 Request processed in 36us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.663246:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788636928.663282:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226102912:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663302:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226103296 00000100:00100000:2.0:1788636928.663305:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226103296 00000100:00100000:2.0:1788636928.663324:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226103808 00000100:00100000:2.0:1788636928.663326:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226103808 00000100:00100000:2.0:1788636928.663343:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226103680 00000100:00100000:2.0:1788636928.663345:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226103680 00000100:00100000:2.0:1788636928.663353:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226104192 00000100:00100000:2.0:1788636928.663355:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226104192 00000100:00100000:2.0:1788636928.663366:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226103936 00000100:00100000:2.0:1788636928.663368:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226103936 00000100:00100000:2.0:1788636928.663377:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226104064 00000100:00100000:2.0:1788636928.663379:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226104064 00000100:00100000:2.0:1788636928.663390:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636928.663395:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226103296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663427:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226103296:12345-0@lo:400:kworker.0 Request processed in 32us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.663439:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636928.663450:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636928.663455:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521226103808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663495:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521226103808:12345-0@lo:400:kworker.0 Request processed in 40us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.663502:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636928.663512:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788636928.663517:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226103680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663540:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226103680:12345-0@lo:400:kworker.0 Request processed in 23us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.663545:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788636928.663554:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788636928.663559:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226104192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663582:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226104192:12345-0@lo:400:kworker.0 Request processed in 23us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.663587:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788636928.663597:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788636928.663602:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226103936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663629:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226103936:12345-0@lo:400:kworker.0 Request processed in 27us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.663634:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788636928.663644:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788636928.663649:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226104064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663673:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226104064:12345-0@lo:400:kworker.0 Request processed in 24us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.663685:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788636928.663702:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636928.663705:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636928.663725:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226103680:0@lo:400:kworker.0 00010000:00080000:2.0:1788636928.663739:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef023fc380 x1875521226104192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636928.663750:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226104192:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663761:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226103296:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663770:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521226103808:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663796:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226104064:0@lo:400:kworker.0 00010000:00080000:2.0:1788636928.663829:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef023fe680 x1875521226103936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636928.663838:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226103936:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.663877:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226102784 00000100:00100000:2.0:1788636928.663881:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226102784 00000100:00100000:2.0:1788636928.663905:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636928.663911:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226102784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636928.663925:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788636928.663961:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226102784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.663966:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788636928.663978:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636928.663998:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226102784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636928.664024:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226103168 00000100:00100000:2.0:1788636928.664027:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226103168 00000100:00100000:2.0:1788636928.664050:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226103552 00000100:00100000:2.0:1788636928.664053:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226103552 00000100:00100000:2.0:1788636928.664074:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636928.664081:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226103168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.664115:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226103168:12345-0@lo:400:kworker.0 Request processed in 35us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.664122:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636928.664133:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636928.664139:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226103552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.664167:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226103552:12345-0@lo:400:kworker.0 Request processed in 28us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.664174:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788636928.664186:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636928.664204:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226103552:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.664223:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226103168:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.664253:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226103424 00000100:00100000:2.0:1788636928.664257:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226103424 00000100:00100000:2.0:1788636928.664278:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226103040 00000100:00100000:2.0:1788636928.664281:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226103040 00000100:00100000:2.0:1788636928.664294:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788636928.664300:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226103424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.664337:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226103424:12345-0@lo:400:kworker.0 Request processed in 36us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.664343:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788636928.664363:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788636928.664368:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226103040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.664399:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226103040:12345-0@lo:400:kworker.0 Request processed in 30us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636928.664405:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788636928.664429:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226103040:0@lo:400:kworker.0 00000100:00100000:2.0:1788636928.664439:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226103424:0@lo:400:kworker.0 00000001:00100000:1.0:1788636929.177686:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 118080cd-cdb0-45eb-bbf8-8278fafb5be9 00000001:00080000:1.0:1788636929.177723:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1788636929.239850:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636929.685864:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636929.685890:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226104320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636929.685969:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636929.686295:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226104320 00000100:00100000:2.0:1788636929.686303:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226104320 00000100:00100000:2.0:1788636929.686361:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636929.686370:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226104320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788636929.686401:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788636929.686499:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226104320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636929.686506:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636929.686606:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226104320:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788636930.261894:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788636930.582295:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788636930.709538:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226104576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636930.709623:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636930.709677:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636930.709684:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226104448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636930.709709:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636930.709777:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226104576 00000100:00100000:1.0:1788636930.709789:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226104576 00000100:00100000:1.0:1788636930.709869:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226104448 00000100:00100000:1.0:1788636930.709872:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226104448 00000100:00100000:1.0:1788636930.709888:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788636930.709897:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226104576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636930.709935:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788636930.709982:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226104576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636930.709989:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788636930.710017:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788636930.710023:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226104448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788636930.710037:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788636930.710059:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226104448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 37us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636930.710065:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788636930.710098:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226104448:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788636930.710108:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002493100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226104576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636930.984466:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636930.986130:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207134208 00000100:00100000:2.0:1788636930.986149:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207134208 00000100:00100000:2.0:1788636930.986272:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00100000:2.0:1788636930.986283:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:15013:x1875521207134208:12345-192.168.202.26@tcp:41:lfs.0 00000004:00000024:2.0:1788636930.986327:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788636930.986495:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:15013:x1875521207134208:12345-192.168.202.26@tcp:41:lfs.0 Request processed in 213us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636930.986504:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00080000:0.0:1788636930.986837:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636930.992083:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636930.992856:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207134336 00000100:00100000:0.0:1788636930.992873:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207134336 00000100:00100000:0.0:1788636930.992983:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 15 00000100:00100000:0.0:1788636930.992995:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:15013:x1875521207134336:12345-192.168.202.26@tcp:41:lfs.0 00000004:00000024:0.0:1788636930.993033:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788636930.993162:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:15013:x1875521207134336:12345-192.168.202.26@tcp:41:lfs.0 Request processed in 168us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636930.993198:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 15 00000100:00080000:2.0:1788636930.994053:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636931.001386:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636931.001514:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207134464 00000100:00100000:2.0:1788636931.001525:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207134464 00000100:00100000:2.0:1788636931.001633:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:2.0:1788636931.001644:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:15013:x1875521207134464:12345-192.168.202.26@tcp:13:lfs.0 00002000:00000024:2.0:1788636931.001671:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788636931.001763:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:15013:x1875521207134464:12345-192.168.202.26@tcp:13:lfs.0 Request processed in 120us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636931.001771:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00080000:0.0:1788636931.003382:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636931.005055:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636931.006159:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207134592 00000100:00100000:2.0:1788636931.006173:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207134592 00000100:00100000:2.0:1788636931.006274:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00100000:2.0:1788636931.006285:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:15013:x1875521207134592:12345-192.168.202.26@tcp:13:lfs.0 00002000:00000024:2.0:1788636931.006319:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788636931.006414:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:15013:x1875521207134592:12345-192.168.202.26@tcp:13:lfs.0 Request processed in 131us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636931.006422:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00080000:0.0:1788636931.007321:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788636931.286170:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636931.334716:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636931.335016:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207134720 00000100:00100000:1.0:1788636931.335028:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207134720 00000100:00100000:1.0:1788636931.335106:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 132 00000100:00100000:1.0:1788636931.335117:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+10:15045:x1875521207134720:12345-192.168.202.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788636931.335136:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636931.335155:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839874 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39405 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636931.335188:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39405 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636931.335201:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab36000/0x5b741ef42e839874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39405 expref: 11 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636931.335214:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36000, rc 0) 00000100:00100000:1.0:1788636931.335758:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15045:x1875521207134720:12345-192.168.202.26@tcp:101:mount.lustre.0 Request processed in 638us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.335767:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 132 00000100:00100000:3.0:1788636931.349626:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636931.349749:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207134848 00000100:00100000:2.0:1788636931.349762:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207134848 00000100:00100000:2.0:1788636931.349876:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 133 00000100:00100000:2.0:1788636931.349888:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15045:x1875521207134848:12345-192.168.202.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788636931.350083:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15045:x1875521207134848:12345-192.168.202.26@tcp:501:mount.lustre.0 Request processed in 197us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636931.350092:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 133 00000100:00100000:0.0:1788636931.365590:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636931.365698:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207134976 00000100:00100000:1.0:1788636931.365719:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207134976 00000100:00100000:1.0:1788636931.365776:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 134 00000100:00100000:1.0:1788636931.365786:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15045:x1875521207134976:12345-192.168.202.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788636931.365964:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15045:x1875521207134976:12345-192.168.202.26@tcp:503:mount.lustre.0 Request processed in 180us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.365972:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 134 00000100:00100000:3.0:1788636931.380829:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636931.381087:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207135104 00000100:00100000:0.0:1788636931.381099:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207135104 00000100:00100000:0.0:1788636931.381161:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 135 00000100:00100000:0.0:1788636931.381172:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15052:x1875521207135104:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636931.381345:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15052:x1875521207135104:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 174us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636931.381354:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 135 00000100:00100000:3.0:1788636931.426675:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636931.427532:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207135232 00000100:00100000:2.0:1788636931.427544:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207135232 00000100:00100000:2.0:1788636931.427609:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 136 00000100:00100000:2.0:1788636931.427619:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15052:x1875521207135232:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788636931.427767:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15052:x1875521207135232:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 149us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636931.427774:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 136 00000100:00100000:2.0:1788636931.432919:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636931.433039:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207135360 00000100:00100000:1.0:1788636931.433059:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207135360 00000100:00100000:1.0:1788636931.433102:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 137 00000100:00100000:1.0:1788636931.433121:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15052:x1875521207135360:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788636931.433244:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15052:x1875521207135360:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 124us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.433249:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 137 00000100:00100000:3.0:1788636931.437703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636931.438002:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207135488 00000100:00100000:0.0:1788636931.438014:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207135488 00000100:00100000:0.0:1788636931.438084:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 138 00000100:00100000:0.0:1788636931.438095:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:15045:x1875521207135488:12345-192.168.202.26@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636931.438112:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636931.438131:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e83987b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39436 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636931.438160:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e83987b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39436 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636931.438171:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6400/0x5b741ef42e83987b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39436 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636931.438180:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6400, rc 0) 00000100:00100000:0.0:1788636931.438243:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:15045:x1875521207135488:12345-192.168.202.26@tcp:101:mount.lustre.0 Request processed in 150us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636931.438265:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 138 00000100:00100000:3.0:1788636931.447005:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636931.447122:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207135616 00000100:00100000:2.0:1788636931.447134:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207135616 00000100:00100000:2.0:1788636931.447209:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 139 00000100:00100000:2.0:1788636931.447220:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:15045:x1875521207135616:12345-192.168.202.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788636931.447248:0:17196:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788636931.447274:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788636931.447278:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788636931.447281:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788636931.447284:0:17196:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788636931.447286:0:17196:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788636931.449371:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:15045:x1875521207135616:12345-192.168.202.26@tcp:256:mount.lustre.0 Request processed in 2141us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636931.449387:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 139 00000100:00100000:3.0:1788636931.453940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636931.458400:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207135744 00000100:00100000:1.0:1788636931.458418:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207135744 00000100:00100000:1.0:1788636931.459357:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 140 00000100:00100000:1.0:1788636931.459373:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:15045:x1875521207135744:12345-192.168.202.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788636931.459394:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636931.459415:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e839882 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3943d expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636931.459450:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e839882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3943d expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636931.459775:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e839882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3943d expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636931.459789:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37600, rc 0) 00000100:00100000:1.0:1788636931.459948:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:15045:x1875521207135744:12345-192.168.202.26@tcp:101:mount.lustre.0 Request processed in 579us (6018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.459957:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 140 00000100:00100000:3.0:1788636931.472481:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636931.472756:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207135872 00000100:00100000:0.0:1788636931.472769:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207135872 00000100:00100000:0.0:1788636931.472862:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 141 00000100:00100000:0.0:1788636931.472873:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:15045:x1875521207135872:12345-192.168.202.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788636931.473046:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:15045:x1875521207135872:12345-192.168.202.26@tcp:501:mount.lustre.0 Request processed in 174us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636931.473055:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 141 00000100:00100000:2.0:1788636931.481073:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636931.481311:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207136000 00000100:00100000:1.0:1788636931.481323:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207136000 00000100:00100000:1.0:1788636931.481437:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 142 00000100:00100000:1.0:1788636931.481449:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:15045:x1875521207136000:12345-192.168.202.26@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788636931.481667:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:15045:x1875521207136000:12345-192.168.202.26@tcp:503:mount.lustre.0 Request processed in 220us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.481676:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 142 00000100:00100000:3.0:1788636931.485618:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636931.485789:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207136128 00000100:00100000:2.0:1788636931.485801:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207136128 00000100:00100000:2.0:1788636931.485891:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 143 00000100:00100000:2.0:1788636931.485903:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:15055:x1875521207136128:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788636931.486067:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:15055:x1875521207136128:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 166us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636931.486076:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 143 00000100:00100000:3.0:1788636931.498903:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636931.499260:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207136256 00000100:00100000:1.0:1788636931.499272:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207136256 00000100:00100000:1.0:1788636931.499391:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 144 00000100:00100000:1.0:1788636931.499404:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:15055:x1875521207136256:12345-192.168.202.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788636931.499667:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:15055:x1875521207136256:12345-192.168.202.26@tcp:502:llog_process_th.0 Request processed in 264us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.499676:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 144 00000100:00100000:3.0:1788636931.519487:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636931.519534:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636931.519572:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636931.519597:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636931.519615:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636931.519637:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636931.519664:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207137152 00000100:00100000:3.0:1788636931.519675:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207137152 00000100:00100000:3.0:1788636931.519723:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207137024 00000100:00100000:3.0:1788636931.519726:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207137024 00000100:00100000:3.0:1788636931.519736:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207136384 00000100:00100000:3.0:1788636931.519738:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207136384 00000100:00100000:3.0:1788636931.519746:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207136640 00000100:00100000:3.0:1788636931.519748:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207136640 00000100:00100000:3.0:1788636931.519759:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 41 00000100:00100000:3.0:1788636931.519768:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2398:x1875521207137152:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636931.519886:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2398:x1875521207137152:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 117us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636931.519894:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 41 00000100:00100000:3.0:1788636931.519912:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 42 00000100:00100000:3.0:1788636931.519919:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:2398:x1875521207137024:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636931.519960:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:2398:x1875521207137024:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 42us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636931.519967:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 42 00000100:00100000:3.0:1788636931.519979:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:3.0:1788636931.519983:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875521207136384:12345-192.168.202.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788636931.520012:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 82a22fbf-07be-41b1-a654-c0d7700cefae@192.168.202.26@tcp t0 exp 0000000000000000 cur 600 last 0 00000020:00000080:3.0:1788636931.520069:0:17205:0:(genops.c:1385:class_connect()) connect: client 82a22fbf-07be-41b1-a654-c0d7700cefae, cookie 0x5b741ef42e839889 00000004:00100000:3.0:1788636931.520093:0:17205:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788636931.520178:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9cf03b951800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636931.520205:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2397:x1875521207136384:12345-192.168.202.26@tcp:38:mount.lustre.0 Request processed in 221us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636931.520212:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:3.0:1788636931.520228:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:3.0:1788636931.520232:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875521207136640:12345-192.168.202.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788636931.520249:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 82a22fbf-07be-41b1-a654-c0d7700cefae@192.168.202.26@tcp t0 exp 0000000000000000 cur 600 last 0 00000020:00000080:3.0:1788636931.520268:0:17205:0:(genops.c:1385:class_connect()) connect: client 82a22fbf-07be-41b1-a654-c0d7700cefae, cookie 0x5b741ef42e839890 00000004:00100000:3.0:1788636931.520283:0:17205:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788636931.520329:0:17205:0:(import.c:65:import_set_state_nolock()) ffff9cf03b955800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636931.520352:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2397:x1875521207136640:12345-192.168.202.26@tcp:38:mount.lustre.0 Request processed in 118us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636931.520359:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:2.0:1788636931.522143:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207137408 00000100:00100000:2.0:1788636931.522159:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207137408 00000100:00100000:2.0:1788636931.522225:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207137280 00000100:00100000:2.0:1788636931.522229:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207137280 00000100:00100000:2.0:1788636931.522267:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:1.0:1788636931.522305:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:2.0:1788636931.522310:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2398:x1875521207137408:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636931.522321:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2398:x1875521207137280:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636931.522476:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2398:x1875521207137280:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 159us (2876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.522485:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:2.0:1788636931.524123:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2398:x1875521207137408:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 1801us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636931.524140:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:3.0:1788636931.529042:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636931.530954:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207136512 00000100:00100000:0.0:1788636931.530970:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207136512 00000100:00100000:0.0:1788636931.531072:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00080000:2.0:1788636931.531081:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636931.531087:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:0:x1875521207136512:12345-192.168.202.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788636931.531132:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788636931.531903:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:0:x1875521207136512:12345-192.168.202.26@tcp:41:mount.lustre.0 Request processed in 812us (2861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636931.531915:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:2.0:1788636931.532294:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636931.532470:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207136896 00000100:00100000:1.0:1788636931.532480:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207136896 00000100:00100000:1.0:1788636931.532583:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:1.0:1788636931.532595:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15045:x1875521207136896:12345-192.168.202.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788636931.532624:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788636931.532673:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15045:x1875521207136896:12345-192.168.202.26@tcp:41:mount.lustre.0 Request processed in 82us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.532680:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:3.0:1788636931.550544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636931.550714:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636931.551189:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207137536 00000100:00100000:1.0:1788636931.551209:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207137536 00000100:00100000:1.0:1788636931.551276:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207136768 00000100:00100000:1.0:1788636931.551279:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207136768 00000100:00100000:1.0:1788636931.551337:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:1.0:1788636931.551350:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15045:x1875521207137536:12345-192.168.202.26@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788636931.551469:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15045:x1875521207137536:12345-192.168.202.26@tcp:40:mount.lustre.0 Request processed in 122us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.551478:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:1.0:1788636931.551499:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:1.0:1788636931.551505:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+6:0:x1875521207136768:12345-192.168.202.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788636931.551532:0:17206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788636931.551567:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+6:0:x1875521207136768:12345-192.168.202.26@tcp:41:mount.lustre.0 Request processed in 62us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.551574:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00080000:3.0:1788636931.551759:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636931.557407:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636931.557466:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636931.557511:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636931.557675:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207137664 00000100:00100000:1.0:1788636931.557686:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207137664 00000100:00100000:1.0:1788636931.557734:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207137792 00000100:00100000:1.0:1788636931.557738:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207137792 00000100:00100000:3.0:1788636931.557740:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207137920 00000100:00100000:3.0:1788636931.557744:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207137920 00000100:00100000:1.0:1788636931.557758:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:1.0:1788636931.557768:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875521207137664:12345-192.168.202.26@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788636931.557782:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 4 00000100:00100000:3.0:1788636931.557788:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15045:x1875521207137920:12345-192.168.202.26@tcp:900:mount.lustre.0 00010000:00080000:1.0:1788636931.557860:0:18714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 82a22fbf-07be-41b1-a654-c0d7700cefae@192.168.202.26@tcp t0 exp 0000000000000000 cur 600 last 0 00000100:00100000:3.0:1788636931.557888:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15045:x1875521207137920:12345-192.168.202.26@tcp:900:mount.lustre.0 Request processed in 100us (499us total) trans 0 rc 0/0 00000020:00000080:1.0:1788636931.557892:0:18714:0:(genops.c:1385:class_connect()) connect: client 82a22fbf-07be-41b1-a654-c0d7700cefae, cookie 0x5b741ef42e839897 00000100:00100000:3.0:1788636931.557895:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 4 00002000:00100000:1.0:1788636931.557904:0:18714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 82a22fbf-07be-41b1-a654-c0d7700cefae/ffff9cef0275a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788636931.557922:0:18714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788636931.558019:0:18714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788636931.558072:0:18714:0:(import.c:65:import_set_state_nolock()) ffff9cef02758800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636931.558125:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2397:x1875521207137664:12345-192.168.202.26@tcp:8:mount.lustre.0 Request processed in 358us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.558133:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:1.0:1788636931.558152:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:1.0:1788636931.558157:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875521207137792:12345-192.168.202.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788636931.558176:0:18714:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 82a22fbf-07be-41b1-a654-c0d7700cefae@192.168.202.26@tcp t0 exp 0000000000000000 cur 600 last 0 00000020:00000080:1.0:1788636931.558197:0:18714:0:(genops.c:1385:class_connect()) connect: client 82a22fbf-07be-41b1-a654-c0d7700cefae, cookie 0x5b741ef42e83989e 00002000:00100000:1.0:1788636931.558202:0:18714:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 82a22fbf-07be-41b1-a654-c0d7700cefae/ffff9cef0275b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788636931.558209:0:18714:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788636931.558265:0:18714:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788636931.558281:0:18714:0:(import.c:65:import_set_state_nolock()) ffff9cef0275d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636931.558305:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2397:x1875521207137792:12345-192.168.202.26@tcp:8:mount.lustre.0 Request processed in 147us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.558312:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:2.0:1788636931.567319:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636931.567426:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207138048 00000100:00100000:1.0:1788636931.567440:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207138048 00000100:00100000:1.0:1788636931.567519:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 1 00000100:00100000:1.0:1788636931.567533:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15045:x1875521207138048:12345-192.168.202.26@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788636931.567670:0:17208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788636931.567761:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15045:x1875521207138048:12345-192.168.202.26@tcp:33:mount.lustre.0 Request processed in 231us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636931.567769:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 1 00000100:00100000:3.0:1788636931.813294:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636931.814440:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207138176 00000100:00100000:0.0:1788636931.814470:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207138176 00000100:00100000:0.0:1788636931.814717:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:0.0:1788636931.814730:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15078:x1875521207138176:12345-192.168.202.26@tcp:101:mkdir.0 00010000:00010000:0.0:1788636931.814757:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636931.814974:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6600/0x5b741ef42e8398a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3946e expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636931.815048:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636931.815063:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636931.815077:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636931.815188:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788636931.815256:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636931.815282:0:17205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636931.815309:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c6600/0x5b741ef42e8398a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3946e expref: 8 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636931.815328:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3946e expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636931.815336:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ec200) 00010000:00010000:0.0:1788636931.815339:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636931.815343:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c7c00, rc 0) 00000100:00100000:0.0:1788636931.815472:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+7:15078:x1875521207138176:12345-192.168.202.26@tcp:101:mkdir.0 Request processed in 744us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636931.815479:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 22 00010000:00010000:1.0:1788636932.310187:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636933.333053:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636933.781053:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226104704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636933.781153:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636933.781262:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226104704 00000100:00100000:2.0:1788636933.781270:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226104704 00000100:00100000:2.0:1788636933.781350:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788636933.781361:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226104704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636933.781395:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788636933.781444:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226104704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636933.781462:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788636933.781568:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636933.781607:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226104704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636933.781932:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226104960:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.781977:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.782007:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226105472:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.782032:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.782050:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226105984:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.782072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.782091:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788636933.782097:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226105088:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.782118:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.782136:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226105600:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.782156:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.782173:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226106112:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.782197:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.782225:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226104960 00000100:00100000:0.0:1788636933.782230:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226104960 00000100:00100000:0.0:1788636933.782263:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788636933.782270:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226104960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.782327:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226104960:12345-0@lo:400:kworker.0 Request processed in 57us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636933.782334:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788636933.782355:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226105472 00000100:00100000:0.0:1788636933.782359:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226105472 00000100:00100000:0.0:1788636933.782387:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226105088 00000100:00100000:0.0:1788636933.782390:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226105088 00000100:00100000:0.0:1788636933.782401:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226105600 00000100:00100000:0.0:1788636933.782403:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226105600 00000100:00100000:0.0:1788636933.782416:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636933.782423:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226105472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.782480:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226105472:12345-0@lo:400:kworker.0 Request processed in 57us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636933.782487:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636933.782500:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636933.782506:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226105088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.782535:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226105088:12345-0@lo:400:kworker.0 Request processed in 29us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636933.782541:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788636933.782772:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636933.782775:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636933.782843:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636933.782852:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226105600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.782888:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226105600:12345-0@lo:400:kworker.0 Request processed in 38us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636933.782895:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636933.782915:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226105984 00000100:00100000:0.0:1788636933.782919:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226105984 00000100:00100000:0.0:1788636933.782956:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226106112 00000100:00100000:0.0:1788636933.782959:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226106112 00000100:00100000:0.0:1788636933.782972:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788636933.782977:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226105984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.783009:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875521226105984:12345-0@lo:400:kworker.0 Request processed in 31us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636933.783015:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788636933.783026:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788636933.783032:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226106112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.783057:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226106112:12345-0@lo:400:kworker.0 Request processed in 25us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636933.783072:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788636933.783112:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226104832:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.783146:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.783171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226105344:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.783192:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.783209:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521226105856:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.783226:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.783236:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226106368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636933.783252:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.783269:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788636933.783274:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226105216:0@lo:400:kworker.0 00000100:00100000:1.0:1788636933.783473:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226105856 00000100:00100000:1.0:1788636933.783479:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226105856 00000100:00100000:1.0:1788636933.783513:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788636933.783519:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521226105856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636933.783566:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875521226105856:12345-0@lo:400:kworker.0 Request processed in 46us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636933.783574:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788636933.783594:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636933.783596:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788636933.784506:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226106368 00000100:00100000:2.0:1788636933.784513:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226106368 00000100:00100000:2.0:1788636933.784565:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636933.784573:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226106368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636933.784601:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788636933.784654:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226106368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636933.784661:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636933.786439:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.786490:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226105728:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.786516:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.786531:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226106240:0@lo:400:kworker.0 00000100:00100000:1.0:1788636933.786656:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636933.786671:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226106496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636933.786701:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636933.786734:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226105216 00000100:00100000:1.0:1788636933.786740:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226105216 00000100:00100000:1.0:1788636933.786772:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226105728 00000100:00100000:1.0:1788636933.786774:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226105728 00000100:00100000:1.0:1788636933.786786:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788636933.786794:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226105216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636933.786853:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875521226105216:12345-0@lo:400:kworker.0 Request processed in 59us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636933.786860:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788636933.786875:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788636933.786881:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226105728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636933.786918:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875521226105728:12345-0@lo:400:kworker.0 Request processed in 38us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636933.786924:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788636933.786943:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226106496 00000100:00100000:1.0:1788636933.786946:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226106496 00000100:00100000:1.0:1788636933.786970:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788636933.786976:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226106496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636933.786989:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788636933.787023:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226106496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636933.787029:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788636933.787073:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226106496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788636933.787429:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636933.787471:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3647:1875521226105856:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.787484:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788636933.787500:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226106368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636933.787522:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875521226105216:0@lo:400:kworker.0 00000100:00100000:0.0:1788636933.787532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875521226105728:0@lo:400:kworker.0 00000100:00100000:1.0:1788636933.787651:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226106240 00000100:00100000:1.0:1788636933.787656:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226106240 00000100:00100000:1.0:1788636933.787699:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788636933.787705:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226106240:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788636933.787764:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788636933.788353:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226104832 00000100:00100000:0.0:1788636933.788371:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226104832 00000100:00100000:0.0:1788636933.788408:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788636933.788419:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:3647:x1875521226104832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636933.789376:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226105344 00000100:00100000:2.0:1788636933.789384:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226105344 00000100:00100000:2.0:1788636933.789420:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788636933.789427:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226105344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636933.790614:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875521226106240:12345-0@lo:400:kworker.0 Request processed in 2902us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636933.790625:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788636933.792714:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:3647:x1875521226104832:12345-0@lo:400:kworker.0 Request processed in 4285us (9551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636933.792729:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788636933.800928:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226105344:12345-0@lo:400:kworker.0 Request processed in 11489us (17722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636933.800946:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788636933.801065:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226105088:0@lo:400:kworker.0 00000100:00100000:2.0:1788636933.801081:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226105600:0@lo:400:kworker.0 00000100:00100000:2.0:1788636933.801095:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226106112:0@lo:400:kworker.0 00000100:00100000:2.0:1788636933.801107:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226104960:0@lo:400:kworker.0 00000100:00100000:2.0:1788636933.801119:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226105472:0@lo:400:kworker.0 00010000:00080000:2.0:1788636933.801133:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc7100 x1875521226105984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636933.801144:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3648:1875521226105984:0@lo:400:kworker.0 00010000:00080000:3.0:1788636933.819918:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fcc5f80 x1875521226106240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636933.819940:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3647:1875521226106240:0@lo:400:kworker.0 00000100:00100000:3.0:1788636933.819971:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226104832:0@lo:400:kworker.0 00000100:00100000:3.0:1788636933.819984:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226105344:0@lo:400:kworker.0 00000001:00100000:0.0:1788636934.295247:0:17937:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 82a22fbf-07be-41b1-a654-c0d7700cefae 00000001:00100000:0.0:1788636934.295262:0:17937:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 118080cd-cdb0-45eb-bbf8-8278fafb5be9 00000001:00100000:0.0:1788636934.305844:0:17184:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 82a22fbf-07be-41b1-a654-c0d7700cefae 00000001:00100000:0.0:1788636934.305858:0:17184:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 118080cd-cdb0-45eb-bbf8-8278fafb5be9 00000001:00100000:3.0:1788636934.306663:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 82a22fbf-07be-41b1-a654-c0d7700cefae 00000001:00100000:3.0:1788636934.306672:0:18708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 118080cd-cdb0-45eb-bbf8-8278fafb5be9 00010000:00010000:1.0:1788636934.358669:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636934.806604:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636934.806643:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226106624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636934.806722:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636934.807874:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226106624 00000100:00100000:3.0:1788636934.807888:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226106624 00000100:00100000:3.0:1788636934.807943:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788636934.807954:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226106624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636934.807992:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788636934.808277:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226106624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 324us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636934.808285:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788636934.808672:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226106624:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788636935.381957:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788636935.660752:0:20083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788636935.830726:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226106752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636935.830832:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636935.830893:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226106752 00000100:00100000:0.0:1788636935.830900:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226106752 00000100:00100000:0.0:1788636935.830946:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636935.830955:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226106752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636935.830991:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788636935.831040:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226106752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636935.831047:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636935.831098:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226106752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788636935.833321:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226106880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788636935.833463:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636935.833556:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226106880 00000100:00100000:1.0:1788636935.833566:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226106880 00000100:00100000:1.0:1788636935.833628:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788636935.833638:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226106880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788636935.833693:0:17946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788636935.842826:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875521226106880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9164us (9346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636935.842846:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788636935.849635:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3647:1875521226106880:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788636936.405279:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636936.833201:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636936.833246:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636936.833254:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207138304 00000100:00100000:2.0:1788636936.833264:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207138304 00000100:00100000:0.0:1788636936.833270:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636936.833287:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636936.833312:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 146 00000100:00100000:0.0:1788636936.833312:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636936.833323:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03ace2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:2401:x1875521207138304:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636936.833329:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636936.833343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636936.833361:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636936.833403:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03ace2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:2401:x1875521207138304:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636936.833407:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207138560 00000100:00100000:3.0:1788636936.833411:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207138560 00000100:00100000:2.0:1788636936.833411:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 146 00000100:00100000:3.0:1788636936.833452:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207139072 00000100:00100000:3.0:1788636936.833456:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207139072 00000100:00100000:3.0:1788636936.833468:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207138432 00000100:00100000:3.0:1788636936.833470:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207138432 00000100:00100000:3.0:1788636936.833481:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207138944 00000100:00100000:3.0:1788636936.833484:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207138944 00000100:00100000:3.0:1788636936.833495:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 49 00000100:00100000:3.0:1788636936.833501:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2401:x1875521207138560:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636936.833579:0:17205:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788636936.833589:0:17205:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788636936.837340:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636936.837614:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2401:x1875521207138560:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 4108us (4363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636936.837631:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 49 00000100:00100000:3.0:1788636936.837672:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 50 00000100:00100000:3.0:1788636936.837685:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2401:x1875521207139072:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636936.837742:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2401:x1875521207139072:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 62us (4454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636936.837748:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 50 00000100:00100000:3.0:1788636936.837762:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 51 00000100:00100000:3.0:1788636936.837769:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2401:x1875521207138432:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636936.837792:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2401:x1875521207138432:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 25us (4463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636936.837798:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 51 00000100:00100000:3.0:1788636936.837826:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:3.0:1788636936.837833:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2401:x1875521207138944:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:3.0:1788636936.837855:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2401:x1875521207138944:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 23us (4493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636936.837874:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00080000:2.0:1788636936.841264:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636936.841274:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636936.843033:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207138816 00000100:00100000:1.0:1788636936.843049:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207138816 00000100:00100000:1.0:1788636936.843110:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207139328 00000100:00100000:1.0:1788636936.843114:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207139328 00000100:00100000:1.0:1788636936.843126:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207138688 00000100:00100000:1.0:1788636936.843129:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207138688 00000100:00100000:1.0:1788636936.843141:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207139200 00000100:00100000:1.0:1788636936.843144:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207139200 00000100:00100000:1.0:1788636936.843162:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:1.0:1788636936.843183:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2401:x1875521207138816:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636936.843257:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2401:x1875521207138816:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 77us (9985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636936.843264:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:1.0:1788636936.843281:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:1.0:1788636936.843288:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2401:x1875521207139328:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636936.843311:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2401:x1875521207139328:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 24us (9999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636936.843317:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:1.0:1788636936.843327:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:1.0:1788636936.843334:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2401:x1875521207138688:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636936.843365:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2401:x1875521207138688:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 32us (10021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636936.843372:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:1.0:1788636936.843382:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00100000:1.0:1788636936.843388:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2401:x1875521207139200:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636936.843407:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2401:x1875521207139200:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 20us (6079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636936.843414:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00080000:3.0:1788636936.843794:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636936.843798:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1788636936.981738:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1788636937.386390:0:19526:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 82a22fbf-07be-41b1-a654-c0d7700cefae 00010000:00010000:1.0:1788636937.430577:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636938.453980:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636938.901078:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226107008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636938.901210:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636938.901317:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636938.901325:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226107136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636938.901354:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636938.901466:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226107008 00000100:00100000:3.0:1788636938.901478:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226107008 00000100:00100000:3.0:1788636938.901540:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226107136 00000100:00100000:3.0:1788636938.901543:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226107136 00000100:00100000:3.0:1788636938.901563:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788636938.901575:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226107008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788636938.901616:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788636938.901673:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226107008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636938.901681:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788636938.901702:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788636938.901708:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226107136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636938.901726:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788636938.901750:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226107136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636938.901756:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788636938.901779:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636938.901784:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636938.901894:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226107136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636938.901908:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226107008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636938.904736:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226107264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636938.905048:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226107520:0@lo:400:kworker.0 00000100:00100000:0.0:1788636938.905095:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636938.906595:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226108032:0@lo:400:kworker.0 00000100:00100000:1.0:1788636938.906607:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636938.906669:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636938.906677:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226107776:0@lo:400:kworker.0 00000100:00100000:0.0:1788636938.906691:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226108544:0@lo:400:kworker.0 00000100:00100000:1.0:1788636938.906708:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636938.906728:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226107520 00000100:00100000:1.0:1788636938.906730:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226108288:0@lo:400:kworker.0 00000100:00100000:0.0:1788636938.906737:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226107520 00000100:00100000:1.0:1788636938.906751:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636938.906783:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788636938.906790:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226107392:0@lo:400:kworker.0 00000100:00100000:0.0:1788636938.906794:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788636938.906818:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226107520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636938.906837:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636938.906864:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226107904:0@lo:400:kworker.0 00000100:00100000:0.0:1788636938.906881:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875521226107520:12345-0@lo:400:kworker.0 Request processed in 78us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636938.906886:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636938.906889:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788636938.906902:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226108416:0@lo:400:kworker.0 00000100:00100000:0.0:1788636938.906906:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226107904 00000100:00100000:0.0:1788636938.906916:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226107904 00000100:00100000:1.0:1788636938.906922:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636938.906933:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788636938.906938:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226107904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636938.906950:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226108032 00000100:00100000:1.0:1788636938.906954:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226108032 00000100:00100000:0.0:1788636938.906976:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226107904:12345-0@lo:400:kworker.0 Request processed in 37us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636938.906983:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788636938.907006:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788636938.907013:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226108032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.907128:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226107776 00000100:00100000:3.0:1788636938.907134:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226107776 00000100:00100000:1.0:1788636938.907165:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226108032:12345-0@lo:400:kworker.0 Request processed in 153us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636938.907174:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636938.907175:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226108288 00000100:00100000:3.0:1788636938.907180:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226108288 00000100:00100000:1.0:1788636938.907199:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226108416 00000100:00100000:1.0:1788636938.907204:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226108416 00000100:00100000:3.0:1788636938.907206:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788636938.907218:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226107776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636938.907234:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788636938.907243:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226108288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.907272:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226107776:12345-0@lo:400:kworker.0 Request processed in 56us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636938.907279:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788636938.907296:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788636938.907302:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226108416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.907332:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226108416:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636938.907338:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788636938.907375:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226107648:0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.907406:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636938.907450:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226108160:0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.907477:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636938.907498:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226108672:0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.907524:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636938.907560:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226108160 00000100:00100000:3.0:1788636938.907564:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226108160 00000100:00100000:3.0:1788636938.907584:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226108672 00000100:00100000:3.0:1788636938.907587:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226108672 00000100:00100000:3.0:1788636938.907604:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788636938.907609:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226108160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.907648:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226108160:12345-0@lo:400:kworker.0 Request processed in 38us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636938.907655:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788636938.907669:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788636938.907676:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226108672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.907718:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226108672:12345-0@lo:400:kworker.0 Request processed in 43us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636938.907724:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788636938.907773:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226108160:0@lo:400:kworker.0 00010000:00080000:3.0:1788636938.907788:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef040f0e00 x1875521226108672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636938.907800:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226108672:0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.907865:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226107264 00000100:00100000:3.0:1788636938.907869:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226107264 00000100:00100000:1.0:1788636938.908384:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226108288:12345-0@lo:400:kworker.0 Request processed in 1140us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636938.908392:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788636938.908973:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636938.908986:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226107264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636938.909012:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788636938.909063:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226107264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (4215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636938.909069:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788636938.911518:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226107392 00000100:00100000:1.0:1788636938.911538:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226107392 00000100:00100000:1.0:1788636938.911640:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788636938.911652:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:3646:x1875521226107392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636938.911718:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226107648 00000100:00100000:0.0:1788636938.911723:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226107648 00000100:00100000:0.0:1788636938.911763:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788636938.911765:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:3646:x1875521226107392:12345-0@lo:400:kworker.0 Request processed in 115us (4925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636938.911770:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226107648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636938.911793:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788636938.911828:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226107648:12345-0@lo:400:kworker.0 Request processed in 59us (4422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636938.911834:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788636938.911871:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636938.911878:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636938.911882:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636938.911886:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636938.912043:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226107648:0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.912899:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636938.912961:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3648:1875521226107520:0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.912990:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226108032:0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.913016:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226108544 00000100:00100000:3.0:1788636938.913022:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226108544 00000100:00100000:3.0:1788636938.913071:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788636938.913079:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226108544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636938.913152:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875521226108544:12345-0@lo:400:kworker.0 Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636938.913167:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788636938.913205:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3648:1875521226108544:0@lo:400:kworker.0 00000100:00080000:1.0:1788636938.914268:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636938.914312:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226107392:0@lo:400:kworker.0 00000100:00100000:1.0:1788636938.914330:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226107904:0@lo:400:kworker.0 00010000:00080000:1.0:1788636938.914349:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef040f1500 x1875521226108416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636938.914360:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226108416:0@lo:400:kworker.0 00000100:00100000:1.0:1788636938.914372:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226107776:0@lo:400:kworker.0 00000100:00100000:1.0:1788636938.914385:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226108288:0@lo:400:kworker.0 00000100:00100000:1.0:1788636938.914408:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226107264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788636939.477267:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636939.927144:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226108800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636939.927251:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636939.927372:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226108800 00000100:00100000:3.0:1788636939.927384:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226108800 00000100:00100000:3.0:1788636939.927465:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636939.927477:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226108800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636939.927511:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788636939.927583:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226108800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636939.927591:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788636939.927688:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226108800:0@lo:13:osp-pre-0-1.0 00000020:00000080:2.0:1788636940.089215:0:20232:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeeb515700 20000000:00000080:2.0:1788636940.089241:0:20232:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf03b9b1800 uarg=0000000000000000 20000000:01000000:2.0:1788636940.089302:0:20232:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788636940.089311:0:20232:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788636940.089319:0:20232:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788636940.090444:0:20233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788636940.091067:0:20232:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788636940.097258:0:20232:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788636940.097300:0:20232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.097326:0:20232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e839541 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.097335:0:20232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e839556 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83954f expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.097342:0:20232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03ab36400/0x5b741ef42e839595 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e83958e expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.097349:0:20232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf004b95200/0x5b741ef42e8396fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8396f3 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.097360:0:20232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03ab37a00/0x5b741ef42e839843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393cd expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.097386:0:20232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e839882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3943d expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.097396:0:20232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.097465:0:20232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e839882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3943d expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.097485:0:20232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e839882 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3943d expref: 12 pid: 17198 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636940.097503:0:20232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226108928:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636940.098011:0:20232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03ab37a00/0x5b741ef42e839843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393cd expref: 12 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.098022:0:20232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03ab37a00/0x5b741ef42e839843 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393cd expref: 12 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636940.098031:0:20232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226109056:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636940.098066:0:20232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf004b95200/0x5b741ef42e8396fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e8396f3 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.098075:0:20232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf004b95200/0x5b741ef42e8396fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e8396f3 expref: 23 pid: 17199 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636940.098084:0:20232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226109184:0@lo:104: 00000100:00100000:3.0:1788636940.098139:0:20232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636940.098568:0:20232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03ab36400/0x5b741ef42e839595 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83958e expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.098578:0:20232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03ab36400/0x5b741ef42e839595 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83958e expref: 23 pid: 17198 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636940.098586:0:20232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226109312:0@lo:104: 00000100:00100000:3.0:1788636940.098687:0:20232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636940.099851:0:20232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e839556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e83954f expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.099869:0:20232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e839556 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e83954f expref: 23 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636940.099882:0:20232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226109440:0@lo:104: 00000100:00100000:3.0:1788636940.099932:0:20232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636940.100437:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226109184 00000100:00100000:2.0:1788636940.100450:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226109184 00000100:00100000:2.0:1788636940.100508:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226109312 00000100:00100000:2.0:1788636940.100512:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226109312 00000100:00100000:2.0:1788636940.100541:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636940.100552:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+4:20232:x1875521226109184:12345-0@lo:104: 00010000:00010000:2.0:1788636940.100569:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.100855:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636940.100862:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+4:20232:x1875521226109184:12345-0@lo:104: Request processed in 312us (2723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636940.100871:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636940.100891:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636940.100897:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:20232:x1875521226109312:12345-0@lo:104: 00010000:00010000:2.0:1788636940.100906:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101018:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788636940.101024:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:20232:x1875521226109312:12345-0@lo:104: Request processed in 127us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636940.101050:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788636940.101074:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788636940.101081:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101090:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37e00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:2.0:1788636940.101095:0:19295:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101104:0:19295:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636940.101112:0:19295:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636940.101118:0:19295:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788636940.101161:0:19295:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101168:0:19295:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636940.101195:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101203:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03ab37e00/0x5b741ef42e8396f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e8396fa expref: -99 pid: 19525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101222:0:19295:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636940.101226:0:19295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101243:0:19295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9400 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:2.0:1788636940.101246:0:19295:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101253:0:19295:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636940.101259:0:19295:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636940.101264:0:19295:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788636940.101280:0:19295:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101286:0:19295:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636940.101305:0:19295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101312:0:19295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9400/0x5b741ef42e83958e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839595 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.101325:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636940.101327:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636940.101330:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636940.101359:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226109568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636940.101409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636940.101480:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226109696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636940.101506:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636940.101562:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226109568 00000100:00100000:2.0:1788636940.101568:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226109568 00010000:00010000:0.0:1788636940.101772:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636940.102267:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf004b95200/0x5b741ef42e8396fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8396f3 expref: 24 pid: 17199 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636940.102305:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226109696 00000100:00100000:2.0:1788636940.102309:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226109696 00010000:00010000:2.0:1788636940.102330:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03ab36400/0x5b741ef42e839595 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83958e expref: 25 pid: 17198 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636940.102343:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636940.102351:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+25:3647:x1875521226109568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636940.102365:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636940.102371:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf004b95200/0x5b741ef42e8396fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e8396f3 expref: 25 pid: 17199 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.102381:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf004b95200/0x5b741ef42e8396fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e8396f3 expref: 25 pid: 17199 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.102402:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636940.102466:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+25:3647:x1875521226109568:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636940.102474:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636940.102493:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636940.102500:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+24:3648:x1875521226109696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636940.102508:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636940.102513:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03ab36400/0x5b741ef42e839595 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83958e expref: 24 pid: 17198 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.102532:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03ab36400/0x5b741ef42e839595 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83958e expref: 24 pid: 17198 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.102556:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636940.102584:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+24:3648:x1875521226109696:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636940.102671:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636940.102824:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226109696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636940.102864:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c7a34533-966f-4857-8403-9471b802ebf2:3647:1875521226109568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636940.102999:0:20232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5b741ef42e839541 expref: 23 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.103014:0:20232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5b741ef42e839541 expref: 23 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636940.103027:0:20232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226109824:0@lo:104: 00000100:00100000:3.0:1788636940.103067:0:20232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636940.103079:0:20232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0269329c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788636940.103100:0:20232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf004b95200/0x5b741ef42e8396fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e8396f3 expref: 23 pid: 17199 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636940.103113:0:20232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226109184:0@lo:104: 00010000:00010000:3.0:1788636940.103124:0:20232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab36400/0x5b741ef42e839595 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83958e expref: 22 pid: 17198 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636940.103144:0:20232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226109312:0@lo:104: 00000100:00100000:2.0:1788636940.103274:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226109440 00000100:00100000:2.0:1788636940.103280:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226109440 00000100:00100000:2.0:1788636940.103306:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226109824 00000100:00100000:2.0:1788636940.103309:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226109824 00000100:00100000:2.0:1788636940.103324:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636940.103332:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+4:20232:x1875521226109440:12345-0@lo:104: 00010000:00010000:2.0:1788636940.103346:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.103403:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636940.103409:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+4:20232:x1875521226109440:12345-0@lo:104: Request processed in 79us (3478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636940.103416:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636940.103440:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636940.103447:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:20232:x1875521226109824:12345-0@lo:104: 00010000:00010000:2.0:1788636940.103455:0:17187:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.103489:0:17187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788636940.103494:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c7a34533-966f-4857-8403-9471b802ebf2+3:20232:x1875521226109824:12345-0@lo:104: Request processed in 48us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636940.103507:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788636940.103527:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788636940.103533:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.103542:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:2.0:1788636940.103548:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.103558:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636940.103566:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636940.103573:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788636940.104185:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.104195:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636940.104219:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.104227:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf0061f9a00/0x5b741ef42e83954f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839556 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.104240:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636940.104244:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.104262:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab36800 already unused, calling callback (ffffffffc1381c20) 10000000:00010000:2.0:1788636940.104266:0:17192:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.104274:0:17192:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636940.104281:0:17192:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636940.104287:0:17192:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788636940.104304:0:17192:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.104311:0:17192:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636940.104328:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.104335:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36800/0x5b741ef42e839541 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5b741ef42e839548 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.104353:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636940.104355:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636940.104357:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636940.104377:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226110080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636940.104445:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636940.104510:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636940.104771:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226109952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636940.104852:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788636940.104887:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636940.104903:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226110080 00000100:00100000:2.0:1788636940.104910:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226110080 00000100:00100000:3.0:1788636940.105092:0:20232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226109440:0@lo:104: 00000100:00100000:3.0:1788636940.105105:0:20232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226109824:0@lo:104: 00000100:00100000:1.0:1788636940.105162:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226109952 00000100:00100000:1.0:1788636940.105167:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226109952 00010000:00010000:1.0:1788636940.105190:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e839556 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83954f expref: 23 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636940.105233:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788636940.105242:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7a34533-966f-4857-8403-9471b802ebf2+23:3648:x1875521226109952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636940.105264:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636940.105269:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e839556 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e83954f expref: 23 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636940.105282:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e839556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e83954f expref: 23 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636940.105299:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab37000/0x5b741ef42e839556 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e83954f expref: 23 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636940.105317:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636940.105361:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7a34533-966f-4857-8403-9471b802ebf2+22:3648:x1875521226109952:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636940.105369:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788636940.105458:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e839541 expref: 21 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636940.105487:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636940.105496:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+21:3646:x1875521226110080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636940.105504:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636940.105508:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5b741ef42e839541 expref: 21 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.105517:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5b741ef42e839541 expref: 21 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.105667:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0113c7200/0x5b741ef42e839548 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5b741ef42e839541 expref: 21 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.105679:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636940.105900:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c7a34533-966f-4857-8403-9471b802ebf2+20:3646:x1875521226110080:12345-0@lo:103:ldlm_bl.0 Request processed in 406us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636940.105908:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636940.106022:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c7a34533-966f-4857-8403-9471b802ebf2:3648:1875521226109952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636940.106230:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636940.106308:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207139456 00000100:00100000:1.0:1788636940.106314:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207139456 00010000:00010000:1.0:1788636940.106340:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e839882 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3943d expref: 13 pid: 17198 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636940.106374:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:1.0:1788636940.106382:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03238ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:2400:x1875521207139456:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636940.106393:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636940.106397:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e839882 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3943d expref: 13 pid: 17198 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636940.106409:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e839882 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3943d expref: 13 pid: 17198 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636940.106434:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636940.106499:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03238ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:2400:x1875521207139456:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 117us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636940.106507:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 13 00010000:00010000:2.0:1788636940.107179:0:20232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab37600/0x5b741ef42e839882 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3943d expref: 12 pid: 17198 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636940.107196:0:20232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226108928:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636940.107209:0:20232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20232:1875521226109056:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636940.107252:0:20232:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636940.108188:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c7a34533-966f-4857-8403-9471b802ebf2:3646:1875521226110080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636940.110116:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636940.110298:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207139584 00000100:00100000:2.0:1788636940.110311:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207139584 00010000:00010000:2.0:1788636940.110359:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf03ab37a00/0x5b741ef42e839843 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393cd expref: 12 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636940.110455:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00100000:2.0:1788636940.110467:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:2401:x1875521207139584:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636940.110488:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636940.110496:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf03ab37a00/0x5b741ef42e839843 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393cd expref: 12 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.110514:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf03ab37a00/0x5b741ef42e839843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393cd expref: 12 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.110543:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf03ab37a00/0x5b741ef42e839843 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393cd expref: 12 pid: 17196 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.110564:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.110573:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.110607:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.110616:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.110644:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.110652:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.110660:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94a00 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:2.0:1788636940.110665:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.110676:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.115302:0:20232:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636940.115330:0:20232:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.117378:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.117407:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf004b94a00/0x5b741ef42e8398b3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636940.117441:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636940.117697:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:2401:x1875521207139584:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 7224us (7586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636940.118102:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 14 00010000:00010000:0.0:1788636940.513839:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788636940.827054:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788636940.950571:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226110208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636940.950657:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636940.950890:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226110208 00000100:00100000:0.0:1788636940.950899:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226110208 00000100:00100000:0.0:1788636940.950957:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788636940.950968:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226110208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788636940.951007:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788636940.951056:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226110208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636940.951063:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788636940.951353:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226110336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788636940.951383:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636940.951426:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226110336 00000100:00100000:2.0:1788636940.951430:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226110336 00000100:00100000:2.0:1788636940.951453:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788636940.951459:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226110336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788636940.951491:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788636940.951683:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226110336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 222us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636940.951690:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788636940.951732:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226110336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636940.951839:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226110208:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788636941.528942:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788636941.848196:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788636941.848205:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf03b9d4000 from 13 10000000:01000000:0.0:1788636941.848211:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788636941.848276:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e8398ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636941.848289:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e8398ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636941.848303:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e8398ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636941.848334:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226110464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636941.848429:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636941.848489:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636941.855352:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226110464 00000100:00100000:2.0:1788636941.855378:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226110464 00000100:00100000:2.0:1788636941.855451:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788636941.855462:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+20:17201:x1875521226110464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636941.855484:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636941.855511:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab0400/0x5b741ef42e8398c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8398ba expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.855549:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab0400/0x5b741ef42e8398c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8398ba expref: 21 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.855562:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab0400/0x5b741ef42e8398c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8398ba expref: 21 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.855573:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0400, rc 0) 00000100:00100000:2.0:1788636941.855671:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+21:17201:x1875521226110464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (7242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.855679:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788636941.855746:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226110464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636941.855767:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e8398ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398c1 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.855796:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e8398ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8398c1 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636941.855920:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226110592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.855959:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636941.855992:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636941.856007:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226110592 00000100:00100000:2.0:1788636941.856011:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226110592 00000100:00100000:2.0:1788636941.856036:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788636941.856042:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:17201:x1875521226110592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.856153:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:17201:x1875521226110592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.856160:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788636941.856189:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226110592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.856217:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226110720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.856259:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636941.856273:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636941.856283:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226110720 00000100:00100000:2.0:1788636941.856286:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226110720 00000100:00100000:2.0:1788636941.856307:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788636941.856313:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:17201:x1875521226110720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.856401:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:17201:x1875521226110720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.856407:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788636941.856467:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226110720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788636941.857145:0:20300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788636941.857209:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788636941.857227:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636941.857240:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e8398ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398c1 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.857249:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf0113c7200/0x5b741ef42e8398ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398c1 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636941.857263:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636941.857266:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf00324b000 from 13 10000000:01000000:2.0:1788636941.857270:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636941.857303:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8398c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.857312:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8398c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.857323:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8398c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636941.857342:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226110848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.857387:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636941.857436:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636941.857457:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226110848 00000100:00100000:2.0:1788636941.857464:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226110848 00000100:00100000:2.0:1788636941.857500:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788636941.857509:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+21:17201:x1875521226110848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636941.857538:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636941.857553:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8398cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8398c8 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.857579:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8398cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8398c8 expref: 22 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.857591:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab0000/0x5b741ef42e8398cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8398c8 expref: 22 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.857600:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab0000, rc 0) 00000100:00100000:2.0:1788636941.857638:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+22:17201:x1875521226110848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.857646:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788636941.857685:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226110848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636941.857699:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8398c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398cf expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.857710:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8398c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8398cf expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636941.857760:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226110976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.857783:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636941.857796:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636941.857839:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226110976 00000100:00100000:2.0:1788636941.857842:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226110976 00000100:00100000:2.0:1788636941.857863:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788636941.857870:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+22:17201:x1875521226110976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.857980:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+22:17201:x1875521226110976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.857986:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788636941.858014:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226110976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.858038:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.858075:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636941.858092:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0409e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788636941.858101:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226111104 00000100:00100000:2.0:1788636941.858104:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226111104 00000100:00100000:2.0:1788636941.858121:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788636941.858126:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+22:17201:x1875521226111104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.858191:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+22:17201:x1875521226111104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.858196:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788636941.858228:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788636941.860626:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788636941.861125:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788636941.861152:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636941.861167:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8398c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398cf expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636941.861183:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03aab1c00/0x5b741ef42e8398c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398cf expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636941.861197:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788636941.861199:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf0113d7000 from 13 10000000:01000000:3.0:1788636941.861203:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636941.861257:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf004b94800/0x5b741ef42e8398d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636941.861282:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf004b94800/0x5b741ef42e8398d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636941.861295:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf004b94800/0x5b741ef42e8398d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636941.861338:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636941.861458:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636941.861512:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef043cd540 going to sleep for 11 seconds 00000100:00100000:1.0:1788636941.862515:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226111232 00000100:00100000:1.0:1788636941.862525:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226111232 00000100:00100000:1.0:1788636941.862581:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788636941.862591:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+22:17201:x1875521226111232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636941.862606:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636941.862625:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e8398dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8398d6 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636941.862650:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e8398dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8398d6 expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636941.862661:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03ab37e00/0x5b741ef42e8398dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8398d6 expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636941.862670:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab37e00, rc 0) 00000100:00100000:1.0:1788636941.862734:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+23:17201:x1875521226111232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636941.862741:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788636941.862797:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636941.862830:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf004b94800/0x5b741ef42e8398d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398dd expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636941.862840:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf004b94800/0x5b741ef42e8398d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8398dd expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636941.862919:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002490700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636941.862949:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636941.862970:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397180 going to sleep for 11 seconds 00000100:00100000:1.0:1788636941.862985:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226111360 00000100:00100000:1.0:1788636941.862988:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226111360 00000100:00100000:1.0:1788636941.863010:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788636941.863015:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+23:17201:x1875521226111360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636941.863118:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+23:17201:x1875521226111360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636941.863125:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788636941.863151:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002490700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636941.863178:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002490700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636941.863216:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636941.863228:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397180 going to sleep for 11 seconds 00000100:00100000:1.0:1788636941.863240:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226111488 00000100:00100000:1.0:1788636941.863244:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226111488 00000100:00100000:1.0:1788636941.863263:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788636941.863270:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+23:17201:x1875521226111488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636941.863357:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+23:17201:x1875521226111488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636941.863364:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788636941.863403:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002490700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788636941.875902:0:20303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788636941.876174:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788636941.876227:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636941.876241:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf004b94800/0x5b741ef42e8398d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398dd expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636941.876252:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf004b94800/0x5b741ef42e8398d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398dd expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636941.876263:0:17201:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788636941.876266:0:17201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cef03105000 from 13 10000000:01000000:1.0:1788636941.876269:0:17201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636941.876803:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36400/0x5b741ef42e8398e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636941.876843:0:17201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36400/0x5b741ef42e8398e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636941.876856:0:17201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36400/0x5b741ef42e8398e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636941.876888:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf002490700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636941.876972:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636941.877022:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef02397180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636941.877108:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226111616 00000100:00100000:2.0:1788636941.877117:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226111616 00000100:00100000:2.0:1788636941.877185:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788636941.877198:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+23:17201:x1875521226111616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636941.877215:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636941.877234:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e8398eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5b741ef42e8398e4 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.877264:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e8398eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5b741ef42e8398e4 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.877292:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab1400/0x5b741ef42e8398eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5b741ef42e8398e4 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.877303:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1400, rc 0) 00000100:00100000:2.0:1788636941.877374:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+24:17201:x1875521226111616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.877381:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788636941.877672:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf002490700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636941.877688:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36400/0x5b741ef42e8398e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398eb expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636941.877698:0:17201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36400/0x5b741ef42e8398e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5b741ef42e8398eb expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636941.877776:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636941.877835:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636941.877863:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef043cd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636941.877934:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226111744 00000100:00100000:2.0:1788636941.877938:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226111744 00000100:00100000:2.0:1788636941.877969:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788636941.877976:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:17201:x1875521226111744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636941.878076:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c7a34533-966f-4857-8403-9471b802ebf2+24:17201:x1875521226111744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.878083:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788636941.878146:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636941.878172:0:17201:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636941.878213:0:17201:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636941.878235:0:17201:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef043cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1788636941.878302:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226111872 00000100:00100000:1.0:1788636941.878316:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226111872 00000100:00100000:1.0:1788636941.878346:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788636941.878352:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:17201:x1875521226111872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636941.878436:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:17201:x1875521226111872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636941.878442:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788636941.878476:0:17201:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c7a34533-966f-4857-8403-9471b802ebf2:17201:1875521226111872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788636941.879237:0:20304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788636941.879309:0:17201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788636941.879332:0:17201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636941.879342:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36400/0x5b741ef42e8398e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398eb expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636941.879353:0:17201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.126@tcp lock: ffff9cf03ab36400/0x5b741ef42e8398e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5b741ef42e8398eb expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636941.889116:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636941.890611:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207139712 00000100:00100000:2.0:1788636941.890631:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207139712 00000100:00100000:2.0:1788636941.890707:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 160 00000100:00100000:2.0:1788636941.890723:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+11:14929:x1875521207139712:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636941.890744:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636941.890772:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8398f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39475 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.890827:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8398f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39475 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.890841:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf03aab1a00/0x5b741ef42e8398f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39475 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636941.890860:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03aab1a00, rc 0) 00000100:00100000:2.0:1788636941.890940:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:14929:x1875521207139712:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 Request processed in 221us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.890948:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 160 00000100:00100000:0.0:1788636941.897637:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636941.897708:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207139840 00000100:00100000:1.0:1788636941.897722:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207139840 00000100:00100000:1.0:1788636941.897793:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 161 00000100:00100000:1.0:1788636941.897835:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:14929:x1875521207139840:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636941.898019:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:14929:x1875521207139840:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 Request processed in 215us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636941.898027:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 161 00000100:00100000:0.0:1788636941.913098:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636941.913196:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207139968 00000100:00100000:3.0:1788636941.913207:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207139968 00000100:00100000:3.0:1788636941.913334:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 162 00000100:00100000:3.0:1788636941.913346:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:14929:x1875521207139968:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636941.913512:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aef4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:14929:x1875521207139968:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 Request processed in 168us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636941.913520:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 162 00000100:00100000:1.0:1788636941.919924:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636941.920018:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207140096 00000100:00100000:0.0:1788636941.920029:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207140096 00000100:00100000:0.0:1788636941.920087:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 163 00000100:00100000:0.0:1788636941.920098:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+12:14929:x1875521207140096:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636941.920116:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636941.920136:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8398f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3947c expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636941.920163:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8398f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3947c expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636941.920175:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0113c6a00/0x5b741ef42e8398f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3947c expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636941.920185:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0113c6a00, rc 0) 00000100:00100000:0.0:1788636941.920286:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:14929:x1875521207140096:12345-192.168.202.26@tcp:101:ll_cfg_requeue.0 Request processed in 190us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636941.920294:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 163 00000100:00100000:0.0:1788636941.925320:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636941.925441:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207140224 00000100:00100000:3.0:1788636941.925451:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207140224 00000100:00100000:3.0:1788636941.925551:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 164 00000100:00100000:3.0:1788636941.925562:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:14929:x1875521207140224:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636941.925737:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:14929:x1875521207140224:12345-192.168.202.26@tcp:501:ll_cfg_requeue.0 Request processed in 176us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636941.925745:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 164 00000100:00100000:3.0:1788636941.927677:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636941.927983:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207140352 00000100:00100000:1.0:1788636941.927993:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207140352 00000100:00100000:0.0:1788636941.928178:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 165 00000100:00100000:0.0:1788636941.928190:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:14929:x1875521207140352:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636941.928376:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:14929:x1875521207140352:12345-192.168.202.26@tcp:503:ll_cfg_requeue.0 Request processed in 187us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636941.928385:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 165 00000100:00100000:1.0:1788636941.950086:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636941.950119:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636941.950153:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636941.950264:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207140864 00000100:00100000:2.0:1788636941.950276:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207140864 00000100:00100000:2.0:1788636941.950347:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:2.0:1788636941.950359:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2398:x1875521207140864:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636941.950696:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2398:x1875521207140864:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 338us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.950704:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:0.0:1788636941.950838:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207140608 00000100:00100000:0.0:1788636941.950843:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207140608 00000100:00100000:0.0:1788636941.950878:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:0.0:1788636941.950885:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2398:x1875521207140608:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636941.950915:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2398:x1875521207140608:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 31us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636941.950921:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:0.0:1788636941.951105:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207141120 00000100:00100000:0.0:1788636941.951109:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207141120 00000100:00100000:0.0:1788636941.951142:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:0.0:1788636941.951149:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2398:x1875521207141120:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636941.951185:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2398:x1875521207141120:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 36us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636941.951191:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00080000:3.0:1788636941.951398:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788636941.951403:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636941.952848:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636941.952881:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636941.952908:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636941.952925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636941.952968:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636941.953098:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207140480 00000100:00100000:2.0:1788636941.953106:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207140480 00000100:00100000:2.0:1788636941.953168:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207140992 00000100:00100000:2.0:1788636941.953171:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207140992 00000100:00100000:2.0:1788636941.953196:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:2.0:1788636941.953206:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2398:x1875521207140480:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636941.953269:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2398:x1875521207140480:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 65us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.953276:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:2.0:1788636941.953292:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:2.0:1788636941.953299:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2398:x1875521207140992:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636941.953323:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2398:x1875521207140992:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 24us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.953339:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:2.0:1788636941.953363:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207141376 00000100:00100000:2.0:1788636941.953367:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207141376 00000100:00100000:2.0:1788636941.953390:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207140736 00000100:00100000:2.0:1788636941.953393:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207140736 00000100:00100000:2.0:1788636941.953403:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207141248 00000100:00100000:2.0:1788636941.953405:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207141248 00000100:00100000:2.0:1788636941.953659:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:2.0:1788636941.953668:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2398:x1875521207141376:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636941.953694:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2398:x1875521207141376:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 28us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.953700:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:2.0:1788636941.953711:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:2.0:1788636941.953717:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2398:x1875521207140736:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636941.953742:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2398:x1875521207140736:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 22us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.953748:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:2.0:1788636941.953758:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:2.0:1788636941.953764:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf010357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2398:x1875521207141248:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:2.0:1788636941.953781:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf010357050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2398:x1875521207141248:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 19us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636941.953798:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00080000:1.0:1788636941.954391:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636941.954396:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636941.954400:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636942.549107:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636943.573499:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636943.953752:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636943.953868:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207141504 00000100:00100000:2.0:1788636943.953878:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207141504 00000100:00100000:2.0:1788636943.953985:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:2.0:1788636943.953997:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0237d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:15595:x1875521207141504:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636943.954033:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636943.954219:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839900 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39483 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.954301:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e839907 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.954524:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e839907 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.954541:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e839907 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.954562:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e83990e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.954571:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e83990e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.954578:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e83990e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.954697:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e839915 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.954705:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e839915 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.954712:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e839915 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636943.954763:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788636943.954767:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636943.955196:0:17205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e839915 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955210:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e839907 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955218:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e839907 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955225:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e839907 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955231:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636943.955236:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e839907 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955245:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e839907 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955259:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ec200) 00010000:00010000:2.0:1788636943.955262:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636943.955269:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e839907 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955276:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e839907 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955296:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e83990e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955741:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e83990e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955749:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e83990e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955754:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636943.955757:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e83990e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955763:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e83990e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955772:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cf03a5ec100) 00010000:00010000:2.0:1788636943.955775:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636943.955778:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e83990e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.955785:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e83990e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788636943.956006:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636943.956264:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839900 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39483 expref: 8 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.956284:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f400/0x5b741ef42e839915 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39483 expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.956292:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf03a5eca00) 00010000:00010000:2.0:1788636943.956294:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636943.956309:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153f400, rc 0) 00000100:00100000:2.0:1788636943.956527:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0237d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:15595:x1875521207141504:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 2530us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636943.956537:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:2.0:1788636943.968906:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636943.969232:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207141632 00000100:00100000:3.0:1788636943.969244:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207141632 00000100:00100000:3.0:1788636943.969320:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 5 00000100:00100000:3.0:1788636943.969333:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:15595:x1875521207141632:12345-192.168.202.26@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788636943.969790:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:15595:x1875521207141632:12345-192.168.202.26@tcp:900:lhsmtool_posix.0 Request processed in 459us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636943.969797:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 5 00000100:00100000:1.0:1788636943.996970:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636943.997095:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207141888 00000100:00100000:2.0:1788636943.997107:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207141888 00000100:00100000:2.0:1788636943.997178:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:2.0:1788636943.997190:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:15595:x1875521207141888:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636943.997215:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636943.997237:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e83991c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3948a expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997340:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839923 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997355:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839923 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997368:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839923 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997424:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83992a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997432:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83992a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997440:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83992a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997583:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e400/0x5b741ef42e839931 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997591:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e400/0x5b741ef42e839931 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997598:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e400/0x5b741ef42e839931 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636943.997607:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788636943.997747:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839923 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997754:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839923 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997761:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839923 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997767:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636943.997772:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839923 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997779:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839923 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997792:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf03a5eca00) 00010000:00010000:2.0:1788636943.997795:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636943.997799:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839923 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997863:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839923 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997879:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83992a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997885:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83992a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997890:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83992a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997894:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636943.997897:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83992a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997902:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83992a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997909:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cf03a5ec100) 00010000:00010000:2.0:1788636943.997911:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636943.997914:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83992a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636943.997919:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83992a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.001079:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e83991c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3948a expref: 10 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.001138:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e400/0x5b741ef42e839931 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3948a expref: 9 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.001150:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec500) 00010000:00010000:2.0:1788636944.001153:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636944.001158:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e400, rc 0) 00000100:00100000:2.0:1788636944.001263:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+9:15595:x1875521207141888:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 4074us (4304us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788636944.001273:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:1.0:1788636944.010130:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636944.010586:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207142016 00000100:00100000:2.0:1788636944.010597:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207142016 00000100:00100000:2.0:1788636944.010658:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:2.0:1788636944.010669:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+9:15595:x1875521207142016:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788636944.010786:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+9:15595:x1875521207142016:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 Request processed in 118us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636944.010793:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:1.0:1788636944.019399:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636944.019541:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207142144 00000100:00100000:0.0:1788636944.019578:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207142144 00000100:00100000:0.0:1788636944.019675:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:0.0:1788636944.019688:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:15595:x1875521207142144:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788636944.020103:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636944.026080:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7a34533-966f-4857-8403-9471b802ebf2:3649:1875521226112000:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026162:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026203:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226112512:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026244:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026267:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226113024:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026286:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026301:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226113536:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026336:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026353:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788636944.026359:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226112384:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026382:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026397:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226112896:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026426:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026441:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226113408:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026461:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026484:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226112128:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026509:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026531:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226112640:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026552:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026566:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226113152:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026585:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026597:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788636944.026603:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226112256:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026625:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026644:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226112768:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026662:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026678:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226113280:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026706:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636944.026734:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226112000 00000100:00100000:3.0:1788636944.026742:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226112000 00000100:00100000:3.0:1788636944.026789:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788636944.026798:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+24:3649:x1875521226112000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026870:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c7a34533-966f-4857-8403-9471b802ebf2+24:3649:x1875521226112000:12345-0@lo:400:kworker.0 Request processed in 72us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.026878:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788636944.026913:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226112128 00000100:00100000:3.0:1788636944.026917:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226112128 00000100:00100000:3.0:1788636944.026939:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226112640 00000100:00100000:3.0:1788636944.026942:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226112640 00000100:00100000:3.0:1788636944.026955:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788636944.026961:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226112128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.026997:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226112128:12345-0@lo:400:kworker.0 Request processed in 36us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027004:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788636944.027015:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788636944.027021:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226112640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027048:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226112640:12345-0@lo:400:kworker.0 Request processed in 27us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027054:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788636944.027073:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226112384 00000100:00100000:3.0:1788636944.027076:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226112384 00000100:00100000:3.0:1788636944.027102:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226112896 00000100:00100000:3.0:1788636944.027105:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226112896 00000100:00100000:3.0:1788636944.027116:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226112256 00000100:00100000:3.0:1788636944.027118:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226112256 00000100:00100000:3.0:1788636944.027142:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226112768 00000100:00100000:3.0:1788636944.027145:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226112768 00000100:00100000:3.0:1788636944.027159:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636944.027165:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226112384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027197:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226112384:12345-0@lo:400:kworker.0 Request processed in 32us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027203:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636944.027216:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636944.027221:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226112896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027243:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226112896:12345-0@lo:400:kworker.0 Request processed in 23us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027248:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636944.027258:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788636944.027263:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226112256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027288:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226112256:12345-0@lo:400:kworker.0 Request processed in 25us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027293:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788636944.027304:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788636944.027309:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226112768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027334:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226112768:12345-0@lo:400:kworker.0 Request processed in 25us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027339:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788636944.027363:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226112512 00000100:00100000:3.0:1788636944.027366:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226112512 00000100:00100000:3.0:1788636944.027382:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226113024 00000100:00100000:3.0:1788636944.027384:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226113024 00000100:00100000:3.0:1788636944.027392:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226113536 00000100:00100000:3.0:1788636944.027400:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226113536 00000100:00100000:3.0:1788636944.027429:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226113408 00000100:00100000:3.0:1788636944.027432:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226113408 00000100:00100000:3.0:1788636944.027441:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226113152 00000100:00100000:3.0:1788636944.027443:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226113152 00000100:00100000:3.0:1788636944.027452:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226113280 00000100:00100000:3.0:1788636944.027454:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226113280 00000100:00100000:3.0:1788636944.027466:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788636944.027471:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226112512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027498:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875521226112512:12345-0@lo:400:kworker.0 Request processed in 28us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027503:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788636944.027514:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788636944.027520:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226113024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027542:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875521226113024:12345-0@lo:400:kworker.0 Request processed in 23us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027548:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788636944.027556:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788636944.027561:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226113536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027585:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875521226113536:12345-0@lo:400:kworker.0 Request processed in 23us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027590:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788636944.027600:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788636944.027606:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226113408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027629:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875521226113408:12345-0@lo:400:kworker.0 Request processed in 23us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027634:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788636944.027653:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788636944.027658:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226113152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027686:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875521226113152:12345-0@lo:400:kworker.0 Request processed in 29us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027692:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788636944.027703:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788636944.027709:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226113280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027733:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875521226113280:12345-0@lo:400:kworker.0 Request processed in 24us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.027739:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788636944.027778:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226112256:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027790:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226112768:0@lo:400:kworker.0 00010000:00080000:3.0:1788636944.027803:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef035f1500 x1875521226113280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636944.027840:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3646:1875521226113280:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027853:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226112128:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027863:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226112640:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027874:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3646:1875521226113152:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027917:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226112384:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027927:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226112896:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027936:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3649:1875521226113408:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027957:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7a34533-966f-4857-8403-9471b802ebf2:3649:1875521226112000:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027967:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875521226112512:0@lo:400:kworker.0 00000100:00100000:3.0:1788636944.027976:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875521226113024:0@lo:400:kworker.0 00010000:00080000:3.0:1788636944.027986:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef035f3b80 x1875521226113536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636944.027994:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3649:1875521226113536:0@lo:400:kworker.0 00000004:00080000:1.0:1788636944.028296:0:20104:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 8549us 00000100:00100000:1.0:1788636944.028351:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636944.028363:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef019b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226113664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636944.028418:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636944.028457:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226113664 00000100:00100000:1.0:1788636944.028462:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226113664 00000100:00100000:1.0:1788636944.028497:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788636944.028505:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226113664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636944.028538:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788636944.028578:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226113664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636944.028583:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788636944.028604:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636944.028609:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788636944.028611:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636944.028613:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636944.028635:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef019b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226113664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636944.030922:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226113792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636944.030993:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636944.031153:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226113792 00000100:00100000:2.0:1788636944.031164:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226113792 00000100:00100000:2.0:1788636944.031223:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788636944.031232:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226113792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636944.031264:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788636944.031327:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226113792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636944.031335:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788636944.031381:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226113792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636944.036434:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226113920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636944.036533:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636944.036638:0:18715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226113920 00000100:00100000:2.0:1788636944.036647:0:18715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226113920 00000100:00100000:2.0:1788636944.036700:0:18715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636944.036708:0:18715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226113920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788636944.036731:0:18715:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788636944.045187:0:18715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226113920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8465us (8640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636944.045204:0:18715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788636944.058138:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636944.061653:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:15595:x1875521207142144:12345-192.168.202.26@tcp:59:lhsmtool_posix.0 Request processed in 41955us (42258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636944.061668:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:0.0:1788636944.061705:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207142272 00000100:00100000:0.0:1788636944.061713:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207142272 00000100:00100000:3.0:1788636944.061835:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:3.0:1788636944.061847:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+9:15601:x1875521207142272:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636944.061864:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636944.061889:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e83993f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39491 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.061952:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839946 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.061967:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.061982:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.061999:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83994d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062006:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83994d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062028:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83994d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062097:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062104:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839946 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062111:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839946 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062117:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636944.062122:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839946 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062129:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839946 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062143:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ec200) 00010000:00010000:3.0:1788636944.062146:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636944.062152:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839946 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062158:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839946 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062170:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83994d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062176:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83994d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062190:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83994d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062195:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636944.062197:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83994d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062204:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83994d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062211:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cef024fd700) 00010000:00010000:3.0:1788636944.062214:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636944.062216:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83994d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062222:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83994d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062254:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e83993f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39491 expref: 10 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062266:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ec200) 00010000:00010000:3.0:1788636944.062269:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636944.062273:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e83993f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39491 expref: 10 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.062283:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b95200, rc 0) 00000100:00100000:3.0:1788636944.062313:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+9:15601:x1875521207142272:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 470us (4188us total) trans 0 rc 301/301 00000100:00100000:3.0:1788636944.062330:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:1.0:1788636944.063078:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226113920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636944.087117:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636944.087227:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207142400 00000100:00100000:2.0:1788636944.087243:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207142400 00000100:00100000:2.0:1788636944.087329:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 0 00000100:00100000:2.0:1788636944.087342:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+9:15601:x1875521207142400:12345-192.168.202.26@tcp:700:lfs.0 00000100:00100000:2.0:1788636944.087470:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+9:15601:x1875521207142400:12345-192.168.202.26@tcp:700:lfs.0 Request processed in 130us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636944.087477:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 0 00000100:00100000:1.0:1788636944.092094:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636944.092194:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207142656 00000100:00100000:2.0:1788636944.092209:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207142656 00000100:00100000:2.0:1788636944.092291:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:2.0:1788636944.092306:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef019b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+9:15601:x1875521207142656:12345-192.168.202.26@tcp:36:lfs.0 00010000:00010000:2.0:1788636944.092397:0:17204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636944.092445:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03aab1000/0x5b741ef42e83986d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef393fe expref: 9 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.092469:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ec200) 00010000:00010000:2.0:1788636944.092476:0:17204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636944.092557:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.092573:0:17204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3946e expref: 5 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.092581:0:17204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.092615:0:17204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3946e expref: 5 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.092629:0:17204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3946e expref: 5 pid: 17205 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636944.092645:0:17204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17204:1875521226114048:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636944.092732:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026ba5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636944.095442:0:17204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0320f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17204:1875521226114048:192.168.202.26@tcp:104: 00010000:00010000:2.0:1788636944.095484:0:17204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636944.097440:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636944.097662:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207142784 00000100:00100000:0.0:1788636944.097677:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207142784 00010000:00010000:0.0:1788636944.097769:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3946e expref: 6 pid: 17205 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636944.097858:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 15 00000100:00100000:3.0:1788636944.097881:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:2400:x1875521207142784:12345-192.168.202.26@tcp:103:ldlm_bl.0 00000100:00080000:1.0:1788636944.097899:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788636944.097900:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636944.097911:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3946e expref: 6 pid: 17205 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.097928:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3946e expref: 6 pid: 17205 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.097951:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0113c7c00/0x5b741ef42e8398ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3946e expref: 6 pid: 17205 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.097969:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ec200) 00010000:00010000:3.0:1788636944.097975:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.097987:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.097995:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.098018:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636944.098129:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2400:x1875521207142784:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 253us (696us total) trans 0 rc 0/0 00010000:00010000:2.0:1788636944.098216:0:17204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.098227:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.098255:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.098283:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.098291:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101094:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101118:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101131:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636944.101283:0:17204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000081dbdcb reply state 00000000a5b3166d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101297:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101304:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:1.0:1788636944.101307:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788636944.101311:0:17204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788636944.101316:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788636944.101325:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101333:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101352:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101357:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153e800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636944.101362:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101370:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101381:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ec200) 00010000:00010000:1.0:1788636944.101384:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636944.101388:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101394:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839954 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636944.101423:0:17204:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000081dbdcb reply state 00000000a5b3166d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101432:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.101439:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf03a5ec100) 00010000:00010000:1.0:1788636944.101441:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788636944.101443:0:17204:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788636944.101557:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef019b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+10:15601:x1875521207142656:12345-192.168.202.26@tcp:36:lfs.0 Request processed in 9249us (9473us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788636944.101566:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:3.0:1788636944.105607:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 15 00000040:00080000:1.0:1788636944.151104:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788636944.216431:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636944.217165:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207142912 00000100:00100000:2.0:1788636944.217181:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207142912 00000100:00100000:2.0:1788636944.217289:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 29 00000100:00100000:2.0:1788636944.217303:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+10:15609:x1875521207142912:12345-192.168.202.26@tcp:101:lctl.0 00010000:00010000:2.0:1788636944.217354:0:20104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636944.217392:0:20104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fc00/0x5b741ef42e839969 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39498 expref: -99 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.217505:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e839970 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.217521:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e839970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.217537:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e839970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636944.217609:0:20104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788636944.217614:0:20104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636944.217661:0:20104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e839970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.217690:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fc00/0x5b741ef42e839969 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39498 expref: 12 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.217740:0:20104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e000/0x5b741ef42e839970 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39498 expref: 11 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636944.217750:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecd00) 00010000:00010000:2.0:1788636944.217754:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636944.217758:0:20104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e000, rc 0) 00000100:00100000:2.0:1788636944.218322:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+11:15609:x1875521207142912:12345-192.168.202.26@tcp:101:lctl.0 Request processed in 1008us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636944.218334:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 29 00000100:00100000:2.0:1788636944.263757:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636944.263943:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207143040 00000100:00100000:3.0:1788636944.263958:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207143040 00000100:00100000:3.0:1788636944.264053:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 30 00000100:00100000:3.0:1788636944.264066:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+5:15610:x1875521207143040:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636944.264098:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636944.264129:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839977 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3949f expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.264225:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83997e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.264241:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83997e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.264258:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83997e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636944.264344:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788636944.264348:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636944.264380:0:17206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83997e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.264426:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839977 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3949f expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.264456:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94a00/0x5b741ef42e83997e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3949f expref: 6 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.264469:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecd00) 00010000:00010000:3.0:1788636944.264473:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636944.264502:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b94a00, rc 0) 00000100:00100000:3.0:1788636944.264608:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15610:x1875521207143040:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 544us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.264616:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 30 00000100:00100000:0.0:1788636944.270289:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636944.271735:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207143168 00000100:00100000:3.0:1788636944.271751:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207143168 00000100:00100000:3.0:1788636944.271831:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 31 00000100:00100000:3.0:1788636944.271842:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+6:15610:x1875521207143168:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636944.271862:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636944.271884:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394a6 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.271946:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e83998c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.271959:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e83998c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.271970:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e83998c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.271979:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839993 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.271986:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.271992:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272249:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95c00/0x5b741ef42e83999a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272271:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95c00/0x5b741ef42e83999a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272278:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95c00/0x5b741ef42e83999a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636944.272330:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788636944.272334:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636944.272354:0:17205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95c00/0x5b741ef42e83999a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272366:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e83998c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272373:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e83998c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272380:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e83998c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272385:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636944.272390:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e83998c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272398:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e83998c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272420:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecd00) 00010000:00010000:3.0:1788636944.272424:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636944.272430:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e83998c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272446:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e83998c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272460:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839993 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272467:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839993 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272471:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839993 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272476:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636944.272479:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839993 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272484:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839993 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272491:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf03a5ec100) 00010000:00010000:3.0:1788636944.272493:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636944.272496:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839993 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272501:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839993 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272603:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394a6 expref: 8 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272631:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95c00/0x5b741ef42e83999a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394a6 expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.272639:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:3.0:1788636944.272642:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636944.272645:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b95c00, rc 0) 00000100:00100000:3.0:1788636944.272761:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+7:15610:x1875521207143168:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 920us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.272769:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 31 00000100:00100000:2.0:1788636944.286709:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636944.286786:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207143296 00000100:00100000:3.0:1788636944.286798:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207143296 00000100:00100000:3.0:1788636944.286901:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:3.0:1788636944.286913:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:82a22fbf-07be-41b1-a654-c0d7700cefae+5:15610:x1875521207143296:12345-192.168.202.26@tcp:900:lfs.0 00000100:00080000:1.0:1788636944.287198:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788636944.287233:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:82a22fbf-07be-41b1-a654-c0d7700cefae+5:15610:x1875521207143296:12345-192.168.202.26@tcp:900:lfs.0 Request processed in 321us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.287242:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:2.0:1788636944.291329:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636944.291445:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207143552 00000100:00100000:3.0:1788636944.291457:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207143552 00000100:00100000:3.0:1788636944.291522:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 32 00000100:00100000:3.0:1788636944.291531:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+7:15610:x1875521207143552:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636944.291553:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636944.291574:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e8399a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394ad expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636944.291677:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788636944.291848:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e8399a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394ad expref: 9 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.291865:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecd00) 00010000:00010000:3.0:1788636944.291869:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636944.291875:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e8399a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394ad expref: 9 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.291890:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b95e00, rc 0) 00000100:00100000:3.0:1788636944.291945:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+8:15610:x1875521207143552:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 415us (641us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788636944.291953:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 32 00000100:00100000:2.0:1788636944.299570:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636944.299682:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207143808 00000100:00100000:1.0:1788636944.299694:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207143808 00000100:00100000:1.0:1788636944.299757:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:1.0:1788636944.299769:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+8:15610:x1875521207143808:12345-192.168.202.26@tcp:36:lfs.0 00010000:00010000:1.0:1788636944.299877:0:20104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636944.299916:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95c00/0x5b741ef42e83999a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394a6 expref: 8 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.299941:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:1.0:1788636944.299948:0:20104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636944.299974:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.299992:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.300003:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636944.300232:0:20104:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052d69275 reply state 000000007d1dc875 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.300245:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.300252:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:1.0:1788636944.300255:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788636944.300274:0:20104:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788636944.300283:0:20104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788636944.300381:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+9:15610:x1875521207143808:12345-192.168.202.26@tcp:36:lfs.0 Request processed in 614us (827us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788636944.300390:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 33 00000100:00100000:2.0:1788636944.304260:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636944.304384:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207144064 00000100:00100000:0.0:1788636944.304395:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207144064 00000100:00100000:0.0:1788636944.304469:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 2 00000100:00100000:0.0:1788636944.304481:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+9:15610:x1875521207144064:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:0.0:1788636944.304763:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+10:15610:x1875521207144064:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 285us (513us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788636944.304771:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 2 00000100:00100000:2.0:1788636944.309737:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636944.315959:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207144320 00000100:00100000:3.0:1788636944.315975:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207144320 00000100:00100000:0.0:1788636944.316261:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 34 00000100:00100000:0.0:1788636944.316274:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+10:15610:x1875521207144320:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636944.316307:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636944.316346:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030200/0x5b741ef42e8399b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394b4 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316470:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031200/0x5b741ef42e8399bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316487:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031200/0x5b741ef42e8399bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316500:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031200/0x5b741ef42e8399bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316513:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031000/0x5b741ef42e8399c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316519:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031000/0x5b741ef42e8399c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316525:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031000/0x5b741ef42e8399c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636944.316654:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788636944.316737:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031200/0x5b741ef42e8399bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316745:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031200/0x5b741ef42e8399bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316751:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031200/0x5b741ef42e8399bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316757:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000031200 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636944.316762:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031200/0x5b741ef42e8399bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316780:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031200/0x5b741ef42e8399bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316797:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecd00) 00010000:00010000:0.0:1788636944.316800:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636944.316855:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031200/0x5b741ef42e8399bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316864:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031200/0x5b741ef42e8399bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316878:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031000/0x5b741ef42e8399c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316883:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031000/0x5b741ef42e8399c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316889:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031000/0x5b741ef42e8399c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316894:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000031000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636944.316897:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031000/0x5b741ef42e8399c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316902:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031000/0x5b741ef42e8399c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316909:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf03a5ec100) 00010000:00010000:0.0:1788636944.316911:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636944.316914:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031000/0x5b741ef42e8399c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316929:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031000/0x5b741ef42e8399c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316966:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030200/0x5b741ef42e8399b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394b4 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316976:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecd00) 00010000:00010000:0.0:1788636944.316978:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636944.316981:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030200/0x5b741ef42e8399b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394b4 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636944.316992:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000030200, rc 0) 00000100:00100000:0.0:1788636944.317695:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a22fbf-07be-41b1-a654-c0d7700cefae+11:15610:x1875521207144320:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1417us (7967us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788636944.317705:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 34 00000100:00100000:2.0:1788636944.326767:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636944.329111:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207144448 00000100:00100000:1.0:1788636944.329135:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207144448 00000100:00100000:1.0:1788636944.329242:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 35 00000100:00100000:1.0:1788636944.329252:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+11:15610:x1875521207144448:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636944.329291:0:20104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636944.329340:0:20104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e8399d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394bb expref: -99 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.329490:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.329509:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.329522:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636944.329551:0:20104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788636944.329555:0:20104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788636944.329574:0:20104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.329607:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e8399d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394bb expref: 13 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.329631:0:20104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394bb expref: 12 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.329660:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:1.0:1788636944.329663:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636944.329668:0:20104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf03ab36c00, rc 0) 00000100:00100000:1.0:1788636944.329755:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+12:15610:x1875521207144448:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 504us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636944.329763:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 35 00000100:00100000:2.0:1788636944.341719:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636944.341866:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207144576 00000100:00100000:0.0:1788636944.341880:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207144576 00000100:00100000:0.0:1788636944.341945:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:0.0:1788636944.341955:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+12:15610:x1875521207144576:12345-192.168.202.26@tcp:37:lfs.0 00000100:00100000:0.0:1788636944.347174:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+12:15610:x1875521207144576:12345-192.168.202.26@tcp:37:lfs.0 Request processed in 5206us (5453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636944.347189:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:2.0:1788636944.351219:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636944.351386:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207144832 00000100:00100000:1.0:1788636944.351396:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207144832 00000100:00100000:1.0:1788636944.351521:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 4 00000100:00100000:1.0:1788636944.351533:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aa4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+12:15610:x1875521207144832:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:1.0:1788636944.351791:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aa4c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+13:15610:x1875521207144832:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 259us (593us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788636944.351799:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 4 00000100:00100000:2.0:1788636944.417108:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636944.417384:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207144960 00000100:00100000:1.0:1788636944.417397:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207144960 00000100:00100000:1.0:1788636944.417480:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 36 00000100:00100000:1.0:1788636944.417491:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+11:15616:x1875521207144960:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:1.0:1788636944.417574:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636944.417767:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e8399e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394c2 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.417918:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8399e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.417933:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8399e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.417958:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8399e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.417970:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.418146:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.418156:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.419357:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8399f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.419374:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8399f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.419384:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8399f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636944.419435:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788636944.419439:0:17204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788636944.419479:0:17204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8399f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.419492:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8399e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.419498:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8399e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420091:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8399e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420095:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636944.420099:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8399e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420105:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8399e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420116:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecd00) 00010000:00010000:1.0:1788636944.420119:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636944.420123:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8399e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420127:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37a00/0x5b741ef42e8399e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420144:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420149:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420155:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420159:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636944.420162:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420178:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420187:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf03a5ec100) 00010000:00010000:1.0:1788636944.420189:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636944.420193:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420199:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420673:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36800/0x5b741ef42e8399e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c2 expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420691:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9400/0x5b741ef42e8399f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c2 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.420697:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:1.0:1788636944.420698:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788636944.420700:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9400, rc 0) 00000100:00100000:1.0:1788636944.420800:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+12:15616:x1875521207144960:12345-192.168.202.26@tcp:101:bash.0 Request processed in 3311us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636944.420849:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 36 00000100:00100000:2.0:1788636944.430331:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636944.430461:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207145088 00000100:00100000:0.0:1788636944.430473:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207145088 00000100:00100000:0.0:1788636944.430542:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:0.0:1788636944.430551:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:15616:x1875521207145088:12345-192.168.202.26@tcp:900:bash.0 00000100:00100000:0.0:1788636944.430646:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:15616:x1875521207145088:12345-192.168.202.26@tcp:900:bash.0 Request processed in 96us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636944.430652:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:2.0:1788636944.434612:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636944.434728:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207145344 00000100:00100000:1.0:1788636944.434745:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207145344 00000100:00100000:1.0:1788636944.434860:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 37 00000100:00100000:1.0:1788636944.434873:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+12:15616:x1875521207145344:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:1.0:1788636944.434926:0:20104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636944.434958:0:20104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399fc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394c9 expref: -99 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.435175:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.435202:0:20104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394bb expref: 12 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.435212:0:20104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.435542:0:20104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394bb expref: 12 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.435558:0:20104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394bb expref: 12 pid: 20104 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636944.435572:0:20104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20104:1875521226114176:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636944.435799:0:20104:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026932180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636944.447890:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636944.447973:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207145472 00000100:00100000:3.0:1788636944.447990:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207145472 00010000:00010000:3.0:1788636944.448028:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394bb expref: 13 pid: 20104 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636944.448062:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 16 00000100:00100000:3.0:1788636944.448071:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf012918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+13:2400:x1875521207145472:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636944.448085:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636944.448092:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394bb expref: 13 pid: 20104 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.448106:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394bb expref: 13 pid: 20104 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.448161:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:3.0:1788636944.448166:0:17189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.448177:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.448185:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.448207:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636944.448272:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf012918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a22fbf-07be-41b1-a654-c0d7700cefae+13:2400:x1875521207145472:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 201us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.448279:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 16 00010000:00010000:1.0:1788636944.452101:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab36c00/0x5b741ef42e8399d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394bb expref: 12 pid: 20104 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636944.452128:0:20104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20104:1875521226114176:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636944.452154:0:20104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.452187:0:20104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.452194:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.452226:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.452253:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.452267:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453141:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453153:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453159:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636944.453168:0:20104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788636944.453190:0:20104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453195:0:20104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453201:0:20104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453214:0:20104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9c00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636944.453217:0:20104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453223:0:20104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453246:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:1.0:1788636944.453249:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636944.453254:0:20104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453260:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a03 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636944.453275:0:20104:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a95d002 reply state 00000000e4c60f16 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453286:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453293:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cf040919500) 00010000:00010000:1.0:1788636944.453296:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788636944.453299:0:20104:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788636944.453341:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e8399fc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c9 expref: 15 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453356:0:20104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c9 expref: 14 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.453373:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636944.453375:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788636944.453376:0:20104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8400, rc 0) 00000100:00100000:1.0:1788636944.453720:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0320e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+15:15616:x1875521207145344:12345-192.168.202.26@tcp:101:bash.0 Request processed in 18847us (19129us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788636944.453730:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 37 00000100:00100000:2.0:1788636944.481154:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636944.481250:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207145600 00000100:00100000:3.0:1788636944.481263:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207145600 00000100:00100000:3.0:1788636944.481345:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 38 00000100:00100000:3.0:1788636944.481356:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+15:15616:x1875521207145600:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636944.481385:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636944.481438:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a1f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394d0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.481521:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839a26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.481538:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839a26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.481553:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839a26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636944.481630:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788636944.481634:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788636944.481658:0:17206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839a26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.481671:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839a26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.481700:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a1f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394d0 expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.481724:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839a26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394d0 expref: 16 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.481735:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636944.481738:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636944.481743:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b94400, rc 0) 00000100:00100000:3.0:1788636944.481883:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+16:15616:x1875521207145600:12345-192.168.202.26@tcp:101:bash.0 Request processed in 528us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.481892:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 38 00000100:00100000:2.0:1788636944.486271:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636944.486450:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207145856 00000100:00100000:0.0:1788636944.486460:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207145856 00000100:00100000:0.0:1788636944.486624:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 5 00000100:00100000:0.0:1788636944.486638:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf01291aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+16:15616:x1875521207145856:12345-192.168.202.26@tcp:35:bash.0 00000100:00100000:0.0:1788636944.487104:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf01291aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+17:15616:x1875521207145856:12345-192.168.202.26@tcp:35:bash.0 Request processed in 465us (851us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788636944.487113:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 5 00010000:00010000:2.0:1788636944.596973:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636944.630452:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636944.630746:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207146112 00000100:00100000:3.0:1788636944.630762:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207146112 00000100:00100000:3.0:1788636944.630880:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 39 00000100:00100000:3.0:1788636944.630892:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+17:15626:x1875521207146112:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636944.630925:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636944.630952:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394d7 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636944.631115:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788636944.631498:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a2d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394d7 expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.631517:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecd00) 00010000:00010000:3.0:1788636944.631521:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636944.631528:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394d7 expref: 19 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.631627:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b95e00, rc 0) 00000100:00100000:3.0:1788636944.631780:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+18:15626:x1875521207146112:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 889us (1339us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788636944.631789:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 39 00000100:00100000:2.0:1788636944.646580:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636944.646728:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207146368 00000100:00100000:1.0:1788636944.646740:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207146368 00000100:00100000:1.0:1788636944.646875:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:1.0:1788636944.646885:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+18:15626:x1875521207146368:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:1.0:1788636944.647090:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+19:15626:x1875521207146368:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 206us (521us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788636944.647097:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 6 00000100:00100000:2.0:1788636944.713103:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636944.713380:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207146624 00000100:00100000:3.0:1788636944.713398:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207146624 00000100:00100000:3.0:1788636944.713495:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 40 00000100:00100000:3.0:1788636944.713517:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+19:15629:x1875521207146624:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:3.0:1788636944.713552:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636944.713583:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a3b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394de expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.713746:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839a42 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.713764:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839a42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.713792:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839a42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636944.713858:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788636944.713996:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a3b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394de expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.714018:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839a42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394de expref: 21 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.714028:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636944.714032:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636944.714036:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b95a00, rc 0) 00000100:00100000:3.0:1788636944.714115:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+21:15629:x1875521207146624:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 610us (1029us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788636944.714123:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 40 00000100:00100000:2.0:1788636944.721107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636944.721167:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636944.721282:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207146880 00000100:00100000:3.0:1788636944.721293:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207146880 00000100:00100000:3.0:1788636944.721365:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 0 00000100:00100000:3.0:1788636944.721376:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+21:2400:x1875521207146880:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636944.721392:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636944.721428:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839a42 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394de expref: 21 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636944.721448:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636944.721453:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636944.721534:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+20:2400:x1875521207146880:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 159us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636944.721542:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 0 00000100:00100000:1.0:1788636944.721663:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207146752 00000100:00100000:1.0:1788636944.721668:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207146752 00000100:00100000:1.0:1788636944.721706:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 41 00000100:00100000:1.0:1788636944.721714:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+20:15629:x1875521207146752:12345-192.168.202.26@tcp:54:lfs.0 00010000:00010000:1.0:1788636944.721771:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.721784:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.721795:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.721871:0:20104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.721878:0:20104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a50 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.721885:0:20104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.721892:0:20104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636944.721896:0:20104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.721905:0:20104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a50 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.721914:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636944.721917:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636944.721921:0:20104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a50 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636944.721927:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636944.721965:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+20:15629:x1875521207146752:12345-192.168.202.26@tcp:54:lfs.0 Request processed in 252us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636944.721972:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 41 00000100:00100000:2.0:1788636944.727002:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636944.727101:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207147136 00000100:00100000:1.0:1788636944.727113:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207147136 00000100:00100000:1.0:1788636944.727184:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 7 00000100:00100000:1.0:1788636944.727208:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+20:15629:x1875521207147136:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:1.0:1788636944.727907:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+21:15629:x1875521207147136:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 697us (916us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788636944.727917:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 7 00000040:00080000:0.0:1788636944.918243:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788636945.045753:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636945.045781:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226114304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788636945.045874:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636945.046026:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226114304 00000100:00100000:3.0:1788636945.046036:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226114304 00000100:00100000:3.0:1788636945.046100:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636945.046112:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f17b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226114304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636945.046425:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788636945.046501:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f17b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875521226114304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 391us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636945.046510:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788636945.046608:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3648:1875521226114304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788636945.312594:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636945.313163:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207147392 00000100:00100000:3.0:1788636945.313175:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207147392 00000100:00100000:3.0:1788636945.313316:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 42 00000100:00100000:3.0:1788636945.313328:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef033bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+21:15660:x1875521207147392:12345-192.168.202.26@tcp:101:cat.0 00010000:00010000:3.0:1788636945.313352:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636945.313374:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839a57 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394e5 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636945.313507:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636945.313522:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636945.313535:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636945.313546:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788636945.313698:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839a57 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394e5 expref: 24 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636945.313720:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394e5 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636945.313729:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636945.313733:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636945.313737:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b95e00, rc 0) 00000100:00100000:3.0:1788636945.313865:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef033bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+23:15660:x1875521207147392:12345-192.168.202.26@tcp:101:cat.0 Request processed in 539us (1284us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788636945.313872:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 42 00000100:00080000:1.0:1788636945.314232:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636945.322196:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636945.322607:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207147520 00000100:00100000:0.0:1788636945.322618:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207147520 00000100:00100000:0.0:1788636945.322697:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 1 00000100:00100000:0.0:1788636945.322708:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+23:2399:x1875521207147520:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636945.322726:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636945.322756:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95e00/0x5b741ef42e839a5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394e5 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636945.322775:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:0.0:1788636945.322781:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636945.322886:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+22:2399:x1875521207147520:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 180us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636945.322893:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 1 00000100:00100000:0.0:1788636945.327520:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636945.327755:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207147776 00000100:00100000:2.0:1788636945.327767:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207147776 00000100:00100000:2.0:1788636945.327877:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 8 00000100:00100000:2.0:1788636945.327892:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+22:15660:x1875521207147776:12345-192.168.202.26@tcp:35:cat.0 00000100:00100000:2.0:1788636945.328313:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+23:15660:x1875521207147776:12345-192.168.202.26@tcp:35:cat.0 Request processed in 423us (817us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788636945.328322:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 8 00000100:00100000:2.0:1788636945.432216:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636945.432365:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207148032 00000100:00100000:1.0:1788636945.432378:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207148032 00000100:00100000:1.0:1788636945.432487:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 43 00000100:00100000:1.0:1788636945.432501:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+23:15666:x1875521207148032:12345-192.168.202.26@tcp:101:dd.0 00010000:00010000:1.0:1788636945.432543:0:20104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636945.432571:0:20104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a6c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394ec expref: -99 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.432701:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.432718:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.432731:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636945.432743:0:20104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788636945.432924:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a6c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394ec expref: 26 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.432958:0:20104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394ec expref: 25 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.432967:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636945.432970:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636945.432974:0:20104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9c00, rc 0) 00000100:00100000:1.0:1788636945.433041:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+25:15666:x1875521207148032:12345-192.168.202.26@tcp:101:dd.0 Request processed in 543us (844us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788636945.433049:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 43 00000100:00100000:0.0:1788636945.437594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636945.437858:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207148160 00000100:00100000:2.0:1788636945.437869:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207148160 00000100:00100000:2.0:1788636945.437926:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 2 00000100:00100000:2.0:1788636945.437937:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+25:2401:x1875521207148160:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636945.437955:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636945.437983:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839a73 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394ec expref: 25 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.438003:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:2.0:1788636945.438007:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636945.438069:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+24:2401:x1875521207148160:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 133us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636945.438086:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 2 00000100:00100000:0.0:1788636945.440034:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636945.440229:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207148288 00000100:00100000:2.0:1788636945.440238:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207148288 00000100:00100000:2.0:1788636945.440303:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 44 00000100:00100000:2.0:1788636945.440311:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+24:15666:x1875521207148288:12345-192.168.202.26@tcp:101:dd.0 00010000:00010000:2.0:1788636945.440336:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636945.440355:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e200/0x5b741ef42e839a81 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394f3 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.440388:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.440412:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.440433:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.440707:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e200/0x5b741ef42e839a81 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394f3 expref: 26 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.440725:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394f3 expref: 25 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.440733:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:2.0:1788636945.440736:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788636945.440739:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153ee00, rc 0) 00000100:00100000:2.0:1788636945.440795:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+25:15666:x1875521207148288:12345-192.168.202.26@tcp:101:dd.0 Request processed in 485us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636945.440836:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 44 00000100:00100000:3.0:1788636945.444457:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636945.444769:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207148544 00000100:00100000:1.0:1788636945.444784:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207148544 00000100:00100000:1.0:1788636945.444907:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 45 00000100:00100000:1.0:1788636945.444920:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+25:15666:x1875521207148544:12345-192.168.202.26@tcp:36:dd.0 00010000:00010000:1.0:1788636945.445037:0:20104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636945.445070:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94400/0x5b741ef42e839a26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394d0 expref: 25 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.445094:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636945.445099:0:20104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636945.445343:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.445361:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.445374:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636945.445443:0:20104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788636945.445467:0:20104:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf651997 reply state 00000000bf90bac9 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.445479:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.445486:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636945.445489:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788636945.445491:0:20104:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636945.445608:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+27:15666:x1875521207148544:12345-192.168.202.26@tcp:36:dd.0 Request processed in 689us (1166us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788636945.445617:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 45 00000020:00080000:1.0:1788636945.445622:0:20104:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788636945.526100:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636945.526200:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207148800 00000100:00100000:2.0:1788636945.526212:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207148800 00000100:00100000:2.0:1788636945.526285:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 9 00000100:00100000:2.0:1788636945.526296:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+27:15666:x1875521207148800:12345-192.168.202.26@tcp:35:dd.0 00000100:00100000:2.0:1788636945.526729:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+28:15666:x1875521207148800:12345-192.168.202.26@tcp:35:dd.0 Request processed in 433us (636us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788636945.526738:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 9 00010000:00010000:2.0:1788636945.620994:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636945.858915:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636945.859097:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207148928 00000100:00100000:2.0:1788636945.859111:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207148928 00000100:00100000:2.0:1788636945.859215:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 46 00000100:00100000:2.0:1788636945.859227:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+28:15680:x1875521207148928:12345-192.168.202.26@tcp:101:stat.0 00010000:00010000:2.0:1788636945.859272:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636945.859298:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e200/0x5b741ef42e839a96 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef394fa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.859385:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839a9d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.859734:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839a9d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.859755:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839a9d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.859774:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839aa4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.859802:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.859847:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.859962:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fc00/0x5b741ef42e839aab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.860059:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fc00/0x5b741ef42e839aab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.860069:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fc00/0x5b741ef42e839aab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636945.863965:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788636945.863988:0:17206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636945.864068:0:17206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fc00/0x5b741ef42e839aab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864091:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fc00/0x5b741ef42e839aab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864102:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839a9d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864110:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839a9d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864118:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839a9d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864208:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636945.864213:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839a9d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864221:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839a9d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864238:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:2.0:1788636945.864241:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636945.864247:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839a9d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864254:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839a9d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864334:0:17206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864342:0:17206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839aa4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864348:0:17206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864353:0:17206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153e800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636945.864356:0:17206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864362:0:17206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839aa4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864383:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cf040919500) 00010000:00010000:2.0:1788636945.864386:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636945.864390:0:17206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839aa4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864395:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839aa4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864451:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e200/0x5b741ef42e839a96 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394fa expref: 30 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864466:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fc00/0x5b741ef42e839aab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394fa expref: 29 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636945.864474:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:2.0:1788636945.864476:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636945.864479:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153fc00, rc 0) 00000100:00100000:2.0:1788636945.864567:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+29:15680:x1875521207148928:12345-192.168.202.26@tcp:101:stat.0 Request processed in 5341us (5677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636945.864576:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 46 00000100:00100000:3.0:1788636945.995095:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636945.995227:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207149184 00000100:00100000:1.0:1788636945.995239:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207149184 00000100:00100000:1.0:1788636945.995321:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 47 00000100:00100000:1.0:1788636945.995334:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+29:15686:x1875521207149184:12345-192.168.202.26@tcp:36:truncate.0 00010000:00010000:1.0:1788636945.995416:0:20104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636945.995450:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fc00/0x5b741ef42e839aab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394fa expref: 29 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.995474:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636945.995480:0:20104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636945.995733:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.995754:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.995789:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636945.996018:0:20104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1788636945.996050:0:20104:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2654b4a reply state 00000000369d5205 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.996068:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636945.996076:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636945.996079:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788636945.996082:0:20104:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636945.996243:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+31:15686:x1875521207149184:12345-192.168.202.26@tcp:36:truncate.0 Request processed in 909us (1158us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788636945.996252:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 47 00000020:00080000:1.0:1788636945.996261:0:20104:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788636946.069546:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226114432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788636946.069634:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636946.071989:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226114432 00000100:00100000:2.0:1788636946.072007:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226114432 00000100:00100000:2.0:1788636946.072087:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788636946.072101:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226114432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788636946.072164:0:17210:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788636946.072275:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226114432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 177us (2639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636946.072304:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788636946.072600:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226114432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788636946.073676:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226114560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788636946.073730:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636946.073798:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226114560 00000100:00100000:2.0:1788636946.073827:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226114560 00000100:00100000:2.0:1788636946.073870:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788636946.073878:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226114560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788636946.073908:0:17209:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788636946.074358:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875521226114560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 480us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636946.074365:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788636946.074453:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3647:1875521226114560:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788636946.198370:0:17959:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788636946.209409:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636946.209533:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207149312 00000100:00100000:2.0:1788636946.209547:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207149312 00000100:00100000:2.0:1788636946.209615:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 48 00000100:00100000:2.0:1788636946.209626:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+31:15700:x1875521207149312:12345-192.168.202.26@tcp:101:stat.0 00010000:00010000:2.0:1788636946.209651:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636946.209678:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e200/0x5b741ef42e839ab9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39501 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.209750:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839ac0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.209766:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.209781:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.209793:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839ac7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.209853:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.209860:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.209937:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.209947:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.209955:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636946.209999:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788636946.210003:0:17204:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636946.210022:0:17204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210035:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210044:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210051:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839ac0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210058:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210076:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153e800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636946.210081:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210090:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839ac0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210104:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:2.0:1788636946.210107:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636946.210113:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839ac0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210119:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839ac0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210326:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210335:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839ac7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210341:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210346:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636946.210349:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210357:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210378:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cf040919500) 00010000:00010000:2.0:1788636946.210380:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636946.210384:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839ac7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210390:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f600/0x5b741ef42e839ac7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210436:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e200/0x5b741ef42e839ab9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39501 expref: 33 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210452:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39501 expref: 32 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.210460:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:2.0:1788636946.210463:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636946.210466:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153fa00, rc 0) 00000100:00100000:2.0:1788636946.210711:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+32:15700:x1875521207149312:12345-192.168.202.26@tcp:101:stat.0 Request processed in 1085us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636946.210720:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 48 00000100:00100000:0.0:1788636946.357215:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636946.357593:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207149568 00000100:00100000:1.0:1788636946.357604:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207149568 00000100:00100000:1.0:1788636946.357671:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 49 00000100:00100000:1.0:1788636946.357683:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+32:15710:x1875521207149568:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:1.0:1788636946.357704:0:20104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636946.357729:0:20104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839ad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39508 expref: -99 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636946.357961:0:20104:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788636946.358065:0:20104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839ad5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39508 expref: 34 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.358080:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecd00) 00010000:00010000:1.0:1788636946.358083:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636946.358090:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839ad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39508 expref: 34 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.358105:0:20104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8a00, rc 0) 00000100:00100000:1.0:1788636946.358795:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+33:15710:x1875521207149568:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 1112us (1587us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1788636946.358840:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 49 00000100:00100000:3.0:1788636946.367951:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636946.369988:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207149824 00000100:00100000:1.0:1788636946.370006:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207149824 00000100:00100000:1.0:1788636946.370095:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:1.0:1788636946.370106:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03aa4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+33:15710:x1875521207149824:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:1.0:1788636946.370838:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03aa4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+34:15710:x1875521207149824:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 730us (2906us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788636946.370858:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 10 00000100:00100000:0.0:1788636946.475096:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636946.475229:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207150080 00000100:00100000:3.0:1788636946.475241:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207150080 00000100:00100000:3.0:1788636946.475319:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 50 00000100:00100000:3.0:1788636946.475331:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+34:15716:x1875521207150080:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636946.475362:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636946.475389:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839ae3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3950f expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.475680:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.475710:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c9 expref: 35 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.475718:0:17206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39501 expref: 35 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.475725:0:17206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.475762:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39501 expref: 35 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.475775:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39501 expref: 35 pid: 17204 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636946.475789:0:17206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17206:1875521226114688:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636946.481757:0:17206:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c9 expref: 35 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.481780:0:17206:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c9 expref: 35 pid: 20104 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636946.481799:0:17206:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17206:1875521226114816:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636946.485334:0:17206:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef043cd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788636946.503904:0:17206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17206:1875521226114688:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636946.503933:0:17206:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17206:1875521226114816:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636946.503988:0:17206:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636946.504155:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636946.504190:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636946.504317:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207150208 00000100:00100000:3.0:1788636946.504325:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207150208 00010000:00010000:3.0:1788636946.504372:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39501 expref: 36 pid: 17204 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636946.504427:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207150336 00000100:00100000:3.0:1788636946.504431:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207150336 00010000:00010000:3.0:1788636946.504445:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c9 expref: 37 pid: 20104 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636946.504463:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:3.0:1788636946.504474:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032388c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+37:2400:x1875521207150208:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636946.504497:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636946.504506:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39501 expref: 37 pid: 17204 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504519:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39501 expref: 37 pid: 17204 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504543:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153fa00/0x5b741ef42e839ace lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39501 expref: 37 pid: 17204 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504560:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636946.504566:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504587:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504594:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636946.504654:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032388c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+36:2400:x1875521207150208:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 180us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636946.504663:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 17 00000100:00100000:3.0:1788636946.504717:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 18 00000100:00100000:3.0:1788636946.504724:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+35:2401:x1875521207150336:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636946.504733:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636946.504738:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c9 expref: 35 pid: 20104 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504749:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c9 expref: 35 pid: 20104 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504762:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8400/0x5b741ef42e839a11 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394c9 expref: 35 pid: 20104 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504773:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636946.504777:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504786:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504795:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.504868:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636946.504888:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+34:2401:x1875521207150336:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 165us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636946.505296:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 18 00010000:00010000:3.0:1788636946.505326:0:17206:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.505335:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636946.505359:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788636946.505557:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839ae3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3950f expref: 35 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.505577:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3950f expref: 34 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.505585:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636946.505587:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788636946.505591:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b95200, rc 0) 00000100:00100000:3.0:1788636946.505623:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+34:15716:x1875521207150080:12345-192.168.202.26@tcp:101:bash.0 Request processed in 30295us (30537us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788636946.505630:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 50 00000100:00100000:2.0:1788636946.520561:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636946.520853:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207150592 00000100:00100000:3.0:1788636946.520866:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207150592 00000100:00100000:3.0:1788636946.520943:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 51 00000100:00100000:3.0:1788636946.520955:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+34:15716:x1875521207150592:12345-192.168.202.26@tcp:36:bash.0 00010000:00010000:3.0:1788636946.521417:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.521436:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.521449:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636946.521493:0:17205:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1788636946.521582:0:17205:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9473bd8 reply state 000000000414ec98 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.521654:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.521664:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636946.521667:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788636946.521671:0:17205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636946.521768:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+37:15716:x1875521207150592:12345-192.168.202.26@tcp:36:bash.0 Request processed in 815us (1219us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788636946.521775:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 51 00000020:00080000:3.0:1788636946.521780:0:17205:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788636946.528517:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636946.528648:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207150720 00000100:00100000:0.0:1788636946.528659:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207150720 00000100:00100000:0.0:1788636946.528723:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:0.0:1788636946.528734:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+37:15716:x1875521207150720:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:0.0:1788636946.528758:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636946.528784:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e839aff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39516 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.529239:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e839aff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39516 expref: 38 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.529259:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e839aff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39516 expref: 38 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.529304:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636946.529308:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636946.529313:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000031800, rc 0) 00000100:00100000:1.0:1788636946.529386:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0362e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+38:15716:x1875521207150720:12345-192.168.202.26@tcp:101:bash.0 Request processed in 654us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636946.529403:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 52 00000100:00100000:0.0:1788636946.543555:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636946.544894:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207150848 00000100:00100000:3.0:1788636946.544914:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207150848 00000100:00100000:2.0:1788636946.552120:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 53 00000100:00100000:2.0:1788636946.552141:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+38:15716:x1875521207150848:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:2.0:1788636946.552170:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636946.552220:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e839b06 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3951d expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.552339:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.552361:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3950f expref: 39 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.552375:0:17205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.552432:0:17205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3950f expref: 39 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636946.552446:0:17205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3950f expref: 39 pid: 17206 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636946.552459:0:17205:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04229180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17205:1875521226114944:192.168.202.26@tcp:104: 00000100:00100000:2.0:1788636946.553285:0:17205:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026ba5900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636946.562762:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636946.563233:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207150976 00000100:00100000:3.0:1788636946.563251:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207150976 00010000:00010000:3.0:1788636946.563324:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3950f expref: 40 pid: 17206 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636946.563409:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 19 00000100:00100000:3.0:1788636946.563440:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+40:2400:x1875521207150976:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636946.563455:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636946.563463:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3950f expref: 40 pid: 17206 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.563477:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3950f expref: 40 pid: 17206 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.563500:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636946.563507:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.563537:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.563546:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.563566:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636946.563625:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+40:2400:x1875521207150976:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 189us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636946.563632:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 19 00010000:00010000:0.0:1788636946.564264:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95200/0x5b741ef42e839aea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3950f expref: 39 pid: 17206 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636946.564282:0:17205:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04229180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17205:1875521226114944:192.168.202.26@tcp:104: 00010000:00010000:0.0:1788636946.564305:0:17205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636946.564316:0:17205:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636946.564321:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636946.564376:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788636946.564392:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636946.564429:0:17205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636946.564461:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e839b06 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3951d expref: 39 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636946.564478:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3951d expref: 38 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636946.564486:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:0.0:1788636946.564488:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636946.564491:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153e800, rc 0) 00000100:00100000:0.0:1788636946.564860:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+38:15716:x1875521207150848:12345-192.168.202.26@tcp:101:bash.0 Request processed in 12670us (21293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636946.564870:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 53 00000100:00100000:3.0:1788636946.572945:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636946.573062:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207151232 00000100:00100000:1.0:1788636946.573073:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207151232 00000100:00100000:1.0:1788636946.573138:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:1.0:1788636946.573149:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+38:15716:x1875521207151232:12345-192.168.202.26@tcp:103:bash.0 00010000:00010000:1.0:1788636946.573165:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788636946.573192:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031800/0x5b741ef42e839aff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39516 expref: 38 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.573217:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3951d expref: 37 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.573228:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636946.573233:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636946.573295:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+36:15716:x1875521207151232:12345-192.168.202.26@tcp:103:bash.0 Request processed in 148us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636946.573302:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 3 00000100:00100000:1.0:1788636946.589336:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636946.589849:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207151360 00000100:00100000:3.0:1788636946.589861:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207151360 00000100:00100000:3.0:1788636946.589929:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00100000:3.0:1788636946.589939:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+36:15716:x1875521207151360:12345-192.168.202.26@tcp:58:bash.0 00010000:00010000:3.0:1788636946.590055:0:17206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.590092:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636946.590104:0:17206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636946.594468:0:17206:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636946.598579:0:17206:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788636946.599063:0:17206:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788636946.599230:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+36:15716:x1875521207151360:12345-192.168.202.26@tcp:58:bash.0 Request processed in 9285us (9905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636946.599242:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 54 00000100:00100000:2.0:1788636946.604674:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636946.605184:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207151488 00000100:00100000:1.0:1788636946.605204:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207151488 00000100:00100000:1.0:1788636946.605300:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 55 00000100:00100000:1.0:1788636946.605310:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+36:15716:x1875521207151488:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:1.0:1788636946.605336:0:20104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636946.605363:0:20104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e839b1b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39524 expref: -99 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.605441:0:20104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.605459:0:20104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e839b1b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39524 expref: 37 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.605496:0:20104:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.605511:0:20104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e839b1b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39524 expref: 37 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.606994:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636946.607000:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636946.607012:0:20104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e839b1b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39524 expref: 37 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636946.607028:0:20104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9000, rc 0) 00000100:00100000:1.0:1788636946.609117:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+37:15716:x1875521207151488:12345-192.168.202.26@tcp:101:bash.0 Request processed in 3789us (4436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636946.609150:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 55 00010000:00010000:0.0:1788636946.647770:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788636946.966364:0:17238:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788636946.966375:0:17238:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636946.966415:0:17238:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788636946.966427:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788636946.966593:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcc7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17238:1875521226115072:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636946.966698:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040bc89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636946.972300:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcc7100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17238:1875521226115072:192.168.202.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636946.985765:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636946.988565:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207151616 00000100:00100000:1.0:1788636946.988601:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207151616 00000100:00100000:1.0:1788636946.988673:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 56 00000100:00100000:1.0:1788636946.988685:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+37:15717:x1875521207151616:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788636946.988720:0:17204:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788636946.988880:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+37:15717:x1875521207151616:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 195us (3135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636946.988888:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 56 00000100:00100000:3.0:1788636947.006938:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636947.007096:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207151744 00000100:00100000:0.0:1788636947.007107:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207151744 00000100:00100000:0.0:1788636947.007201:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:0.0:1788636947.007443:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+37:15717:x1875521207151744:12345-192.168.202.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788636947.007648:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030400/0x5b741ef42e839b22 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.007666:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030400/0x5b741ef42e839b22 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.007677:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030400/0x5b741ef42e839b22 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.007711:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e839b29 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.007719:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e839b29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.007725:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e839b29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.007750:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.007759:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.007765:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788636947.008045:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788636947.008096:0:17205:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788636947.008102:0:17205:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788636947.008120:0:17205:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008153:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030400/0x5b741ef42e839b22 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008161:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030400/0x5b741ef42e839b22 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008168:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030400/0x5b741ef42e839b22 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008174:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000030400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636947.008178:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030400/0x5b741ef42e839b22 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008185:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030400/0x5b741ef42e839b22 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008198:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec500) 00010000:00010000:0.0:1788636947.008201:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636947.008205:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030400/0x5b741ef42e839b22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008211:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030400/0x5b741ef42e839b22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008224:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e839b29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008230:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e839b29 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008236:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e839b29 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008250:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000031a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636947.008253:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e839b29 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008259:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e839b29 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008439:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9cef021c8b00) 00010000:00010000:0.0:1788636947.008442:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636947.008446:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e839b29 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008452:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000031a00/0x5b741ef42e839b29 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008467:0:17205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008474:0:17205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008479:0:17205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008484:0:17205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf000030a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636947.008487:0:17205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008616:0:17205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008638:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:0.0:1788636947.008640:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636947.008644:0:17205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.008650:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839b30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636947.008781:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+37:15717:x1875521207151744:12345-192.168.202.26@tcp:34:lhsmtool_posix.0 Request processed in 1338us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636947.008790:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 57 00000100:00100000:2.0:1788636947.030256:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.030527:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207152000 00000100:00100000:1.0:1788636947.030543:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207152000 00000100:00100000:1.0:1788636947.030655:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00100000:1.0:1788636947.030673:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef0422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+37:15717:x1875521207152000:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636947.030708:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636947.030750:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3952b expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.030968:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b3e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.030990:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.031008:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636947.031027:0:17204:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788636947.031157:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b3e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.031169:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b3e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.031205:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.031214:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:1.0:1788636947.031222:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b3e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.031234:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b3e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.031257:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:1.0:1788636947.031262:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636947.031269:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b3e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.031278:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b3e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.031354:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b37 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3952b expref: 39 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.031372:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf03a5ec500) 00010000:00010000:1.0:1788636947.031376:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636947.031384:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3952b expref: 39 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.031410:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8800, rc 0) 00000100:00100000:1.0:1788636947.031550:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef0422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+38:15717:x1875521207152000:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 882us (1311us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1788636947.031586:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 58 00000100:00100000:1.0:1788636947.036111:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.036313:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207152128 00000100:00100000:3.0:1788636947.036323:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207152128 00000100:00100000:3.0:1788636947.036381:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:3.0:1788636947.036400:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+38:15717:x1875521207152128:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788636947.036437:0:20104:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788636947.036581:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+38:15717:x1875521207152128:12345-192.168.202.26@tcp:53:lhsmtool_posix.0 Request processed in 191us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636947.036588:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 59 00000100:00100000:2.0:1788636947.055036:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.055162:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207152384 00000100:00100000:1.0:1788636947.055174:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207152384 00000100:00100000:1.0:1788636947.055244:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:1.0:1788636947.055255:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef04229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+38:15717:x1875521207152384:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636947.055276:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636947.055298:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e839b4c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39532 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788636947.055893:0:17204:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:1.0:1788636947.055902:0:17204:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1788636947.055919:0:17204:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788636947.056088:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839b53 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.056107:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839b53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.056122:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839b53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.056191:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e839b4c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39532 expref: 41 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.056213:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839b53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39532 expref: 40 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.056235:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919200) 00010000:00010000:1.0:1788636947.056237:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636947.056241:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f9c00, rc 0) 00000100:00100000:1.0:1788636947.056304:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef04229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+40:15717:x1875521207152384:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 1051us (1282us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788636947.056312:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 60 00000100:00100000:1.0:1788636947.060871:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.060973:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207152640 00000100:00100000:3.0:1788636947.060985:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207152640 00000100:00100000:3.0:1788636947.061049:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:3.0:1788636947.061061:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf00f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+40:15717:x1875521207152640:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636947.061148:0:20104:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636947.061182:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9c00/0x5b741ef42e839b53 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39532 expref: 40 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061225:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919200) 00010000:00010000:3.0:1788636947.061236:0:20104:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636947.061262:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839b61 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061277:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839b61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061287:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839b61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061301:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b68 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7fb4d5c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061308:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7fb4d5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061314:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7fb4d5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061365:0:20104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839b61 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061373:0:20104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839b61 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061380:0:20104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839b61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061386:0:20104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636947.061390:0:20104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839b61 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061415:0:20104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839b61 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061425:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:3.0:1788636947.061428:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636947.061433:0:20104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839b61 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061439:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839b61 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061450:0:20104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7fb4d5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061456:0:20104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b68 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7fb4d5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061462:0:20104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7fb4d5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061467:0:20104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636947.061470:0:20104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7fb4d5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061476:0:20104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b68 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7fb4d5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061483:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7fb4d5c7 (ffff9cef024fd200) 00010000:00010000:3.0:1788636947.061486:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636947.061489:0:20104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b68 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7fb4d5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.061506:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b68 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7fb4d5c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636947.061759:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf00f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+39:15717:x1875521207152640:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 698us (899us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788636947.061768:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 61 00000100:00100000:2.0:1788636947.066775:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.066915:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207152768 00000100:00100000:1.0:1788636947.066927:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207152768 00000100:00100000:1.0:1788636947.066984:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:1.0:1788636947.066995:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+39:15717:x1875521207152768:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636947.067015:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636947.067039:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b6f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39539 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.067075:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b76 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.067089:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.067101:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.067230:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39539 expref: 41 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.067277:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8a00/0x5b741ef42e839b76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39539 expref: 40 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.067289:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919300) 00010000:00010000:1.0:1788636947.067291:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788636947.067295:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8a00, rc 0) 00000100:00100000:1.0:1788636947.067365:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+40:15717:x1875521207152768:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 373us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.067372:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 62 00000100:00100000:2.0:1788636947.070223:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.070263:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.070295:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.070321:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.070368:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.070387:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.070423:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.070444:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.070475:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207153280 00000100:00100000:2.0:1788636947.070486:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207153280 00000100:00100000:2.0:1788636947.070540:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207153792 00000100:00100000:2.0:1788636947.070544:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207153792 00000100:00100000:0.0:1788636947.070661:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207153152 00000100:00100000:0.0:1788636947.070666:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207153152 00000100:00100000:0.0:1788636947.070688:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207153664 00000100:00100000:0.0:1788636947.070691:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207153664 00000100:00100000:0.0:1788636947.070707:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:0.0:1788636947.070716:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2400:x1875521207153280:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636947.070794:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2400:x1875521207153280:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 78us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636947.070832:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 25 00000100:00100000:0.0:1788636947.070851:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:0.0:1788636947.070857:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2400:x1875521207153152:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636947.070883:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2400:x1875521207153152:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 27us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636947.070888:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:0.0:1788636947.070907:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:0.0:1788636947.070921:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2400:x1875521207153664:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:0.0:1788636947.070949:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2400:x1875521207153664:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00080000:1.0:1788636947.070950:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636947.070957:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636947.070962:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:1.0:1788636947.070975:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207153024 00000100:00100000:1.0:1788636947.070981:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207153024 00000100:00100000:0.0:1788636947.070987:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207152896 00000100:00100000:0.0:1788636947.070993:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207152896 00000100:00100000:1.0:1788636947.071021:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207153536 00000100:00100000:1.0:1788636947.071026:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207153536 00000100:00100000:0.0:1788636947.071030:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 167 00000100:00100000:0.0:1788636947.071040:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:2400:x1875521207152896:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636947.071049:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207153408 00000100:00100000:1.0:1788636947.071054:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207153408 00000100:00100000:0.0:1788636947.071072:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:001b69e6-bbb8-4ee3-8ad9-a4904af6f901+13:2400:x1875521207152896:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 32us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.071078:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:0.0:1788636947.071086:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 167 00000100:00100000:1.0:1788636947.071092:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf002490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2400:x1875521207153024:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636947.071134:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf002490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2400:x1875521207153024:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 46us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.071142:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:1.0:1788636947.071160:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:1.0:1788636947.071168:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2400:x1875521207153536:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636947.071195:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2400:x1875521207153536:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 28us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.071210:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:1.0:1788636947.071228:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:1.0:1788636947.071237:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+12:2400:x1875521207153408:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636947.071286:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a22fbf-07be-41b1-a654-c0d7700cefae+12:2400:x1875521207153408:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 51us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.071293:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00080000:1.0:1788636947.071309:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636947.071312:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788636947.072004:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:1.0:1788636947.072013:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2400:x1875521207153792:12345-192.168.202.26@tcp:400:kworker.0 00000100:00100000:1.0:1788636947.072046:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef03657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a22fbf-07be-41b1-a654-c0d7700cefae+5:2400:x1875521207153792:12345-192.168.202.26@tcp:400:kworker.0 Request processed in 34us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.072052:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:2.0:1788636947.079966:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.080084:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207154048 00000100:00100000:1.0:1788636947.080097:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207154048 00000100:00100000:1.0:1788636947.080194:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:1.0:1788636947.080207:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+40:15717:x1875521207154048:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788636947.080326:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.080349:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.080363:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636947.080740:0:17205:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788636947.080752:0:17205:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 615891944257ns, next at 616891941584ns, rc = 0 00000004:00010000:1.0:1788636947.080838:0:17205:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a51de89b reply state 00000000c9b52304 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.080852:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.080860:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919300) 00010000:00010000:1.0:1788636947.080863:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788636947.080867:0:17205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636947.080977:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+42:15717:x1875521207154048:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 771us (1026us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788636947.080985:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 63 00000100:00100000:0.0:1788636947.086106:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.086236:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207154176 00000100:00100000:3.0:1788636947.086248:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207154176 00000100:00100000:3.0:1788636947.086319:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:3.0:1788636947.086330:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+42:15717:x1875521207154176:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636947.086358:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636947.086381:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b84 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39540 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.086458:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39540 expref: 43 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.086475:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39540 expref: 43 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.086506:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919300) 00010000:00010000:3.0:1788636947.086510:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788636947.086514:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b95600, rc 0) 00000100:00100000:3.0:1788636947.086766:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+43:15717:x1875521207154176:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 437us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636947.086774:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 64 00000100:00100000:0.0:1788636947.090957:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.091101:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207154304 00000100:00100000:1.0:1788636947.091112:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207154304 00000100:00100000:1.0:1788636947.091181:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:1.0:1788636947.091193:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+5:2400:x1875521207154304:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788636947.091505:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2400:x1875521207154304:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 Request processed in 313us (557us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788636947.091513:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:0.0:1788636947.095095:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.095247:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207154560 00000100:00100000:3.0:1788636947.095259:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207154560 00000100:00100000:3.0:1788636947.095351:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:3.0:1788636947.095362:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+43:15717:x1875521207154560:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788636947.095640:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+44:15717:x1875521207154560:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 278us (553us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788636947.095647:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 11 00000100:00100000:0.0:1788636947.098464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.098666:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207154816 00000100:00100000:1.0:1788636947.098677:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207154816 00000100:00100000:1.0:1788636947.098740:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 65 00000100:00100000:1.0:1788636947.098751:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+44:15717:x1875521207154816:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788636947.098887:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+44:15717:x1875521207154816:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 138us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.098911:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 65 00000100:00100000:0.0:1788636947.101972:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.102069:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207154944 00000100:00100000:2.0:1788636947.102081:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207154944 00000100:00100000:2.0:1788636947.102146:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 66 00000100:00100000:2.0:1788636947.102157:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+44:15717:x1875521207154944:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636947.102178:0:20104:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636947.102200:0:20104:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b8b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39547 expref: -99 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.102284:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e839b92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.102300:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e839b92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.102312:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e839b92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636947.102365:0:20104:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788636947.102385:0:20104:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e839b92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.102421:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153e800/0x5b741ef42e839b8b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39547 expref: 46 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.102456:0:20104:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e839b92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39547 expref: 45 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.102465:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919300) 00010000:00010000:2.0:1788636947.102468:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788636947.102471:0:20104:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153ec00, rc 0) 00000100:00100000:2.0:1788636947.102540:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+45:15717:x1875521207154944:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 385us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636947.102547:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 66 00000100:00100000:0.0:1788636947.106250:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.106346:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207155072 00000100:00100000:2.0:1788636947.106359:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207155072 00000100:00100000:2.0:1788636947.106434:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:2.0:1788636947.106445:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2401:x1875521207155072:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636947.106464:0:19786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636947.106487:0:19786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037205808/0x5b741ef42e839b99 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3954e expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636947.106522:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c6f13, blocks: 0x0 00010000:00010000:2.0:1788636947.106546:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=615s v=(0 0) 00010000:00010000:2.0:1788636947.106551:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636947.106572:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037205808/0x5b741ef42e839b99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3954e expref: 7 pid: 19786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.106595:0:19786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000037205808/0x5b741ef42e839b99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3954e expref: 7 pid: 19786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.106635:0:19786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf00153fa00, rc 0) 00000100:00100000:2.0:1788636947.106698:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:2401:x1875521207155072:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 255us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636947.106706:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 24 00000100:00100000:0.0:1788636947.110551:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.110753:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207155328 00000100:00100000:1.0:1788636947.110764:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207155328 00000100:00100000:1.0:1788636947.110849:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:1.0:1788636947.110859:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+45:15717:x1875521207155328:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788636947.110969:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+45:15717:x1875521207155328:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 111us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.110976:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 67 00000100:00100000:0.0:1788636947.123338:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.123728:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207155456 00000100:00100000:3.0:1788636947.123740:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207155456 00000100:00100000:3.0:1788636947.123800:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 68 00000100:00100000:3.0:1788636947.123842:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+45:15717:x1875521207155456:12345-192.168.202.26@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788636947.125953:0:17184:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1788636947.125968:0:17184:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788636947.126020:0:17184:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1788636947.126214:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.126227:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.126235:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.126255:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:0.0:1788636947.126260:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.126267:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.126284:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:0.0:1788636947.126287:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788636947.126292:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.126299:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37600/0x5b741ef42e8399af lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636947.126324:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636947.126341:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226115200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788636947.126417:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636947.126472:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226115200 00000100:00100000:0.0:1788636947.126480:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226115200 00000100:00100000:0.0:1788636947.126539:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788636947.126548:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03a9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226115200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788636947.126888:0:18712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788636947.126893:0:18712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788636947.126895:0:18712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788636947.126897:0:18712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788636947 -> 1788636947 00002000:00010000:0.0:1788636947.126899:0:18712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788636947.126944:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875521226115200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 397us (527us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788636947.126959:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788636947.126980:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788636947.127011:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf03a9d6680/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788636947.127017:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03a9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226115200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788636947.127258:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03a9d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+20:15717:x1875521207155456:12345-192.168.202.26@tcp:44:lhsmtool_posix.0 Request processed in 3417us (3927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636947.127280:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 68 00010000:00010000:2.0:1788636947.127562:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127573:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127581:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127586:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf00153f000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636947.127590:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127596:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127607:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf03a5ec100) 00010000:00010000:2.0:1788636947.127610:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636947.127615:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127621:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153f000/0x5b741ef42e83995b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127641:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127657:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127663:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127668:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf03ab37000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636947.127672:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127678:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127688:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:2.0:1788636947.127690:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636947.127694:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127700:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf03ab37000/0x5b741ef42e839962 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127713:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127720:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127726:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127731:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9e00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636947.127741:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127746:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127753:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cf040919500) 00010000:00010000:2.0:1788636947.127755:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636947.127758:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127763:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9e00/0x5b741ef42e839a0a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127779:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127784:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127788:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127792:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636947.127795:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127799:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127829:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:2.0:1788636947.127833:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636947.127842:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127848:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9a00/0x5b741ef42e839a8f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127861:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127866:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127870:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127875:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f9600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636947.127877:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127882:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127889:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:2.0:1788636947.127892:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636947.127895:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127900:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9600/0x5b741ef42e839ab2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127908:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127913:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127923:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127928:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95a00 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636947.127931:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127937:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127944:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:2.0:1788636947.127947:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636947.127949:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127954:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95a00/0x5b741ef42e839af8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127965:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127971:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127975:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127979:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:2.0:1788636947.127982:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.127995:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.128166:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919300) 00010000:00010000:2.0:1788636947.128169:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788636947.128173:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.128179:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839b7d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636947.139226:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.141640:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207155584 00000100:00100000:2.0:1788636947.141656:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207155584 00000100:00100000:2.0:1788636947.141737:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:2.0:1788636947.141748:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:2401:x1875521207155584:12345-192.168.202.26@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788636947.141897:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:2401:x1875521207155584:12345-192.168.202.26@tcp:16:lhsmtool_posix.0 Request processed in 150us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636947.141906:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 26 00000100:00100000:0.0:1788636947.145975:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.146222:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207155840 00000100:00100000:1.0:1788636947.146233:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207155840 00000100:00100000:1.0:1788636947.146356:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:1.0:1788636947.146369:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+14:15717:x1875521207155840:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788636947.146447:0:17205:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636947.146477:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ec00/0x5b741ef42e839b92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39547 expref: 14 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.146508:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919300) 00010000:00010000:1.0:1788636947.146514:0:17205:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636947.146548:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e839ba0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.146574:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e839ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.146608:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e839ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636947.146731:0:17205:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fedd491d reply state 00000000a054aa3b transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e839ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.146744:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9200/0x5b741ef42e839ba0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17205 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.146751:0:17205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919300) 00010000:00010000:1.0:1788636947.146753:0:17205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788636947.146756:0:17205:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636947.146913:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+15:15717:x1875521207155840:12345-192.168.202.26@tcp:36:lhsmtool_posix.0 Request processed in 546us (947us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788636947.146921:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 69 00000100:00100000:0.0:1788636947.153795:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.153961:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207155968 00000100:00100000:1.0:1788636947.153973:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207155968 00000100:00100000:1.0:1788636947.154037:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:1.0:1788636947.154049:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:15717:x1875521207155968:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636947.154068:0:18712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636947.154090:0:18712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39555 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.154132:0:18712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037205808/0x5b741ef42e839b99 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3954e expref: 8 pid: 19786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.154142:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636947.154164:0:18712:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636947.154172:0:18712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 8 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.154210:0:18712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037205808/0x5b741ef42e839b99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3954e expref: 8 pid: 19786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.154224:0:18712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037205808/0x5b741ef42e839b99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3954e expref: 8 pid: 19786 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636947.154241:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18712:1875521226115328:192.168.202.26@tcp:104: 00000100:00100000:1.0:1788636947.154324:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf00823f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788636947.157725:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.157874:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18712:1875521226115328:192.168.202.26@tcp:104: 00010000:00010000:1.0:1788636947.157911:0:18712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 8 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.157937:0:18712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0061f8800, rc 0) 00000100:00100000:1.0:1788636947.158001:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+8:15717:x1875521207155968:12345-192.168.202.26@tcp:101:lhsmtool_posix.0 Request processed in 3953us (4216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.158009:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 27 00000100:00100000:2.0:1788636947.161960:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207156096 00000100:00100000:2.0:1788636947.161976:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207156096 00010000:00010000:2.0:1788636947.162029:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037205808/0x5b741ef42e839b99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3954e expref: 8 pid: 19786 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636947.162082:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:2.0:1788636947.162093:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+8:2400:x1875521207156096:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636947.162111:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636947.162145:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037205808/0x5b741ef42e839b99 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3954e expref: 8 pid: 19786 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.162176:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037205808/0x5b741ef42e839b99 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3954e expref: 8 pid: 19786 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.162200:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037205808/0x5b741ef42e839b99 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3954e expref: 8 pid: 19786 timeout: 715 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.162218:0:17189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636947.162223:0:17189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636947.162230:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 7 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.162241:0:17189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 7 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.162287:0:17189:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 7 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636947.162303:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17189:1875521226115456:192.168.202.26@tcp:105: 00000100:00100000:2.0:1788636947.162416:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf026ba5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636947.166157:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:17189:1875521226115456:192.168.202.26@tcp:105: 00010000:00010000:2.0:1788636947.166192:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636947.166311:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:2400:x1875521207156096:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 4215us (8594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636947.166334:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 20 00000100:00100000:0.0:1788636947.170727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.171240:0:18713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207156224 00000100:00100000:3.0:1788636947.171252:0:18713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207156224 00000100:00100000:3.0:1788636947.171347:0:18713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:3.0:1788636947.171359:0:18713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:2400:x1875521207156224:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788636947.171544:0:18713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788636947.171549:0:18713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788636946 00002000:00010000:3.0:1788636947.171552:0:18713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788636944 00002000:00010000:3.0:1788636947.172026:0:18713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788636947 -> 1788636946 00002000:00010000:3.0:1788636947.172031:0:18713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788636947.172101:0:18713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+8:2400:x1875521207156224:12345-192.168.202.26@tcp:2:lhsmtool_posix.0 Request processed in 742us (1382us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788636947.172129:0:18713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 28 00000100:00100000:0.0:1788636947.178060:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.178204:0:18714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207156352 00000100:00100000:3.0:1788636947.178215:0:18714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207156352 00000100:00100000:3.0:1788636947.178312:0:18714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 29 00000100:00100000:3.0:1788636947.178324:0:18714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+8:2400:x1875521207156352:12345-192.168.202.26@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788636947.178374:0:18714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.178405:0:18714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 8 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.178415:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636947.178419:0:18714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636947.178425:0:18714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.178464:0:18714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 8 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.178479:0:18714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 8 pid: 18712 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636947.178505:0:18714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18714:1875521226115584:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636947.178705:0:18714:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef043cde40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636947.188933:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.189102:0:18714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18714:1875521226115584:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636947.189144:0:18714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636947.189854:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207156480 00000100:00100000:1.0:1788636947.189864:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207156480 00010000:00010000:1.0:1788636947.189909:0:17190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 9 pid: 18712 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636947.189954:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 21 00000100:00100000:1.0:1788636947.189974:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+9:2401:x1875521207156480:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636947.189990:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636947.190014:0:17190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 9 pid: 18712 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.190027:0:17190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 9 pid: 18712 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.190054:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001daaea5b/0x5b741ef42e839ba7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39555 expref: 9 pid: 18712 timeout: 715 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.190072:0:17190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1788636947.190077:0:17190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 1) 00010000:00010000:1.0:1788636947.190083:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.190093:0:17190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.190125:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636947.190187:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+8:2401:x1875521207156480:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 215us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.190195:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 21 00010000:00010000:3.0:1788636947.190273:0:18714:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.190281:0:18714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.190300:0:18714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.190307:0:18714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.190314:0:18714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.190320:0:18714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94600 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636947.190325:0:18714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.190333:0:18714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.190344:0:18714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.190359:0:18714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aff559b7/0x5b741ef42e839bae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636947.190418:0:18714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:2400:x1875521207156352:12345-192.168.202.26@tcp:1:lhsmtool_posix.0 Request processed in 12096us (12369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636947.190426:0:18714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 29 00000100:00100000:0.0:1788636947.195282:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.195374:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207156736 00000100:00100000:3.0:1788636947.195384:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207156736 00000100:00100000:3.0:1788636947.195457:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 70 00000100:00100000:3.0:1788636947.195467:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+15:15717:x1875521207156736:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788636947.195569:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.195586:0:20104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394f3 expref: 15 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.195595:0:20104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.195629:0:20104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394f3 expref: 15 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.195643:0:20104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394f3 expref: 15 pid: 17204 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636947.195656:0:20104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20104:1875521226115712:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636947.195768:0:20104:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef043cdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636947.199356:0:20104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20104:1875521226115712:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636947.199385:0:20104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636947.205047:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.207890:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207156864 00000100:00100000:2.0:1788636947.207908:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207156864 00010000:00010000:2.0:1788636947.207966:0:17189:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394f3 expref: 16 pid: 17204 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636947.208071:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 22 00000100:00100000:2.0:1788636947.208082:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+16:2401:x1875521207156864:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636947.208100:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636947.208108:0:17189:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394f3 expref: 16 pid: 17204 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.208123:0:17189:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394f3 expref: 16 pid: 17204 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.208147:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf00153ee00/0x5b741ef42e839a88 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef394f3 expref: 16 pid: 17204 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.208166:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:2.0:1788636947.208172:0:17189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e839b1b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39524 expref: 15 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.208183:0:17189:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.208191:0:17189:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.208220:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636947.208260:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636947.208331:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+15:2401:x1875521207156864:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 250us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636947.208339:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 22 00010000:00010000:3.0:1788636947.208416:0:20104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.208423:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.208646:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.208658:0:20104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b84 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39540 expref: 15 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.208666:0:20104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.208694:0:20104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39540 expref: 15 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.208707:0:20104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b84 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39540 expref: 15 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636947.208720:0:20104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20104:1875521226115840:192.168.202.26@tcp:104: 00000100:00100000:3.0:1788636947.208785:0:20104:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef043cde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636947.215191:0:20104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20104:1875521226115840:192.168.202.26@tcp:104: 00010000:00010000:3.0:1788636947.215240:0:20104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636947.215880:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.216054:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207156992 00000100:00100000:1.0:1788636947.216063:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207156992 00010000:00010000:1.0:1788636947.216104:0:17191:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b84 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39540 expref: 16 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636947.216163:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:1.0:1788636947.216174:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf032388050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+16:2400:x1875521207156992:12345-192.168.202.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636947.216191:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636947.216198:0:17191:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b84 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39540 expref: 16 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.216210:0:17191:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b84 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39540 expref: 16 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.216232:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95600/0x5b741ef42e839b84 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39540 expref: 16 pid: 17206 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.216247:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919300) 00010000:00010000:1.0:1788636947.216252:0:17191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.216261:0:17191:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.216269:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.216301:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636947.216458:0:20104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.216466:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636947.216609:0:20104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788636947.216725:0:20104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1788636947.216773:0:20104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1788636947.216888:0:20104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20104:1875521226115968:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788636947.216939:0:20104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636947.216964:0:20104:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf040b1b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636947.217147:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226115968 00000100:00100000:3.0:1788636947.217152:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226115968 00000100:00100000:3.0:1788636947.217199:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788636947.217208:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:20104:x1875521226115968:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788636947.217285:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:20104:x1875521226115968:12345-0@lo:1000:mdt00_003.0 Request processed in 79us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636947.217292:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788636947.217330:0:20104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20104:1875521226115968:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788636947.217485:0:20104:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1788636947.217526:0:20104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20104:1875521226116096:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788636947.217583:0:20104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636947.217609:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226116096 00000100:00100000:3.0:1788636947.217614:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226116096 00000100:00100000:3.0:1788636947.217637:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788636947.217643:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20104:x1875521226116096:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788636947.217730:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20104:x1875521226116096:12345-0@lo:1000:mdt00_003.0 Request processed in 86us (146us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788636947.217736:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788636947.217769:0:20104:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef043cd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636947.217787:0:20104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20104:1875521226116096:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788636947.217848:0:20104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217856:0:20104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217869:0:20104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217874:0:20104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636947.217879:0:20104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217887:0:20104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217899:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919300) 00010000:00010000:3.0:1788636947.217902:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788636947.217907:0:20104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217913:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bbc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217943:0:20104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217950:0:20104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217954:0:20104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217959:0:20104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95800 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636947.217962:0:20104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217977:0:20104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.217985:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636947.217987:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788636947.217993:0:20104:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e839b1b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39524 expref: 19 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.218003:0:20104:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e839b1b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39524 expref: 19 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.218011:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e839b1b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39524 expref: 19 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.218058:0:20104:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f9000/0x5b741ef42e839b1b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39524 expref: 19 pid: 20104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636947.218068:0:20104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20104:1875521226116224:192.168.202.26@tcp:105: 00000100:00100000:1.0:1788636947.218369:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf032388050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+19:2400:x1875521207156992:12345-192.168.202.26@tcp:103:ldlm_bl.0 Request processed in 2194us (2488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.218379:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 23 00000100:00100000:3.0:1788636947.219756:0:20104:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef043cd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788636947.231898:0:20104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20104:1875521226116224:192.168.202.26@tcp:105: 00010000:00010000:3.0:1788636947.231934:0:20104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.231947:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839b14 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.231983:0:20104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bc3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232014:0:20104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232027:0:20104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232038:0:20104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bc3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232043:0:20104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bc3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232049:0:20104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bc3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232054:0:20104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636947.232058:0:20104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bc3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232065:0:20104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bc3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232075:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636947.232078:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636947.232082:0:20104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bc3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232087:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bc3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232096:0:20104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232108:0:20104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232114:0:20104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232119:0:20104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636947.232122:0:20104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232137:0:20104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232146:0:20104:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636947.232148:0:20104:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636947.232151:0:20104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.232156:0:20104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94000/0x5b741ef42e839bb5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20104 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788636947.232514:0:17238:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788636947.232520:0:17238:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636947.232545:0:17238:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788636947.232568:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788636947.233738:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+18:15717:x1875521207156736:12345-192.168.202.26@tcp:57:lhsmtool_posix.0 Request processed in 38261us (38456us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788636947.233752:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 70 00000020:00080000:3.0:1788636947.233761:0:20104:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788636947.241341:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.241725:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207157120 00000100:00100000:1.0:1788636947.241762:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207157120 00000100:00100000:1.0:1788636947.241853:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:1.0:1788636947.241866:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+18:15716:x1875521207157120:12345-192.168.202.26@tcp:49:bash.0 00000100:00100000:1.0:1788636947.242008:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+18:15716:x1875521207157120:12345-192.168.202.26@tcp:49:bash.0 Request processed in 144us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636947.242016:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 12 00000100:00100000:3.0:1788636947.249925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.250887:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207157376 00000100:00100000:1.0:1788636947.250900:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207157376 00000100:00100000:1.0:1788636947.251028:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 13 00000100:00100000:1.0:1788636947.251041:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+18:15717:x1875521207157376:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788636947.251326:0:17207:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788636947.251361:0:17207:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1788636947.251408:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.251428:0:17207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.251441:0:17207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.251450:0:17207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.251456:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.251463:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636947.251519:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636947.251873:0:17192:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636947.251882:0:17192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.251899:0:17192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0061f8800 already unused, calling callback (ffffffffc0d844f0) 00010000:00010000:3.0:1788636947.251903:0:17192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.251911:0:17192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.251925:0:17192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf040919300) 00010000:00010000:3.0:1788636947.251929:0:17192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788636947.251935:0:17192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.251942:0:17192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0061f8800/0x5b741ef42e839bca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.251958:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636947.251959:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636947.251961:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636947.258707:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+20:15717:x1875521207157376:12345-192.168.202.26@tcp:35:lhsmtool_posix.0 Request processed in 7652us (8778us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1788636947.258726:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 13 00000020:00080000:1.0:1788636947.258737:0:17207:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788636947.259219:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.260711:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207157504 00000100:00100000:3.0:1788636947.260726:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207157504 00000100:00100000:3.0:1788636947.260803:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 30 00000100:00100000:3.0:1788636947.260834:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+7:15716:x1875521207157504:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636947.260853:0:19786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636947.260881:0:19786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e839bd1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3955c expref: -99 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788636947.260908:0:19786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9c6f12, atime: 0x6a9c6f10, ctime: 0x6a9c6f12, blocks: 0x0 00010000:00010000:3.0:1788636947.260930:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=616s v=(0 0) 00010000:00010000:3.0:1788636947.260952:0:19786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636947.260963:0:19786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e839bd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3955c expref: 8 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.260981:0:19786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009f93f8df/0x5b741ef42e839bd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3955c expref: 8 pid: 19786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.260996:0:19786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b94000, rc 0) 00000100:00100000:3.0:1788636947.261070:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+8:15716:x1875521207157504:12345-192.168.202.26@tcp:101:bash.0 Request processed in 239us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636947.261078:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 30 00000100:00100000:2.0:1788636947.267996:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.270909:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207157632 00000100:00100000:3.0:1788636947.270928:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207157632 00000100:00100000:3.0:1788636947.271005:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:3.0:1788636947.271016:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+20:15716:x1875521207157632:12345-192.168.202.26@tcp:101:bash.0 00010000:00010000:3.0:1788636947.271036:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636947.271056:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bd8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef39563 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.271094:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839bdf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.271110:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839bdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.271122:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839bdf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.271254:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bd8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39563 expref: 22 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.271280:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95800/0x5b741ef42e839bdf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef39563 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.271290:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636947.271293:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636947.271297:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf004b95800, rc 0) 00000100:00100000:3.0:1788636947.271374:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+21:15716:x1875521207157632:12345-192.168.202.26@tcp:101:bash.0 Request processed in 359us (3388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636947.271381:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 71 00000100:00100000:3.0:1788636947.281979:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636947.282157:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207157888 00000100:00100000:2.0:1788636947.282168:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207157888 00000100:00100000:2.0:1788636947.282230:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 14 00000100:00100000:2.0:1788636947.282240:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef040f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+21:15716:x1875521207157888:12345-192.168.202.26@tcp:35:bash.0 00000001:00080000:2.0:1788636947.282471:0:17208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1788636947.282674:0:17208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1788636947.282794:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef040f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:118080cd-cdb0-45eb-bbf8-8278fafb5be9+24:15716:x1875521207157888:12345-192.168.202.26@tcp:35:bash.0 Request processed in 554us (825us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788636947.282802:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 14 00000020:00080000:2.0:1788636947.282927:0:17208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788636947.394174:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:0.0:1788636947.394286:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207158144 00000100:00100000:0.0:1788636947.394299:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207158144 00000100:00100000:0.0:1788636947.394367:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 72 00000100:00100000:0.0:1788636947.394379:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+24:15727:x1875521207158144:12345-192.168.202.26@tcp:101:lfs.0 00010000:00010000:0.0:1788636947.394440:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636947.394464:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839be6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc8a1e82acef3956a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636947.394592:0:17206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788636947.394710:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839be6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3956a expref: 26 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.394726:0:17206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf03a5ecd00) 00010000:00010000:0.0:1788636947.394729:0:17206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636947.394735:0:17206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf000030a00/0x5b741ef42e839be6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.26@tcp remote: 0xc8a1e82acef3956a expref: 26 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636947.394763:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf000030a00, rc 0) 00000100:00100000:0.0:1788636947.394905:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:118080cd-cdb0-45eb-bbf8-8278fafb5be9+25:15727:x1875521207158144:12345-192.168.202.26@tcp:101:lfs.0 Request processed in 525us (741us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1788636947.394913:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 72 00000100:00100000:0.0:1788636947.405041:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:3.0:1788636947.405352:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207158272 00000100:00100000:3.0:1788636947.405375:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207158272 00000100:00100000:3.0:1788636947.405446:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 73 00000100:00100000:3.0:1788636947.405457:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+25:15727:x1875521207158272:12345-192.168.202.26@tcp:34:lfs.0 00010000:00010000:3.0:1788636947.405535:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bf4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405563:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405577:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405593:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95000/0x5b741ef42e839bfb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405601:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95000/0x5b741ef42e839bfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405624:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95000/0x5b741ef42e839bfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405709:0:17204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405717:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405723:0:17204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636947.405780:0:17204:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405794:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bf4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405800:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bf4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405845:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bf4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405853:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b94600 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636947.405857:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bf4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405864:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bf4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405876:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf040919600) 00010000:00010000:3.0:1788636947.405886:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636947.405892:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bf4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405898:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b94600/0x5b741ef42e839bf4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405912:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95000/0x5b741ef42e839bfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405917:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95000/0x5b741ef42e839bfb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405922:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95000/0x5b741ef42e839bfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405927:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95000 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636947.405929:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95000/0x5b741ef42e839bfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405947:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95000/0x5b741ef42e839bfb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405955:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cef024fde00) 00010000:00010000:3.0:1788636947.405958:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636947.405961:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95000/0x5b741ef42e839bfb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405965:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95000/0x5b741ef42e839bfb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405980:0:17204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405992:0:17204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.405998:0:17204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.406002:0:17204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf004b95400 already unused, calling callback (ffffffffc19924f0) 00010000:00010000:3.0:1788636947.406005:0:17204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.406011:0:17204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.406018:0:17204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf040919800) 00010000:00010000:3.0:1788636947.406020:0:17204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636947.406023:0:17204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636947.406028:0:17204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf004b95400/0x5b741ef42e839c02 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636947.406110:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+25:15727:x1875521207158272:12345-192.168.202.26@tcp:34:lfs.0 Request processed in 653us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636947.406118:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 73 00000100:00100000:0.0:1788636947.411149:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:1.0:1788636947.413926:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207158528 00000100:00100000:1.0:1788636947.413947:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207158528 00000100:00100000:1.0:1788636947.414029:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 15 00000100:00100000:1.0:1788636947.414042:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+25:15727:x1875521207158528:12345-192.168.202.26@tcp:35:lfs.0 00000100:00100000:1.0:1788636947.414379:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+26:15727:x1875521207158528:12345-192.168.202.26@tcp:35:lfs.0 Request processed in 339us (3237us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1788636947.414388:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 15 00010000:00010000:2.0:1788636947.669002:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636948.693570:0:17193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788636948.930147:0:20383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1788636949.142357:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef023fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226116352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636949.142456:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636949.143517:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226116480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636949.143563:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636949.143590:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef04229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226116992:0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.143617:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636949.143635:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf01291aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226117504:0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.143655:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636949.143673:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226118016:0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.143698:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636949.143724:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788636949.143731:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226116608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636949.143767:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636949.143778:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226117120:0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.143799:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636949.143852:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226117632:0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.143875:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636949.143893:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf03fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226118144:0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.143913:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636949.144005:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226116352 00000100:00100000:1.0:1788636949.144013:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226116352 00000100:00100000:1.0:1788636949.144055:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226116480 00000100:00100000:1.0:1788636949.144059:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226116480 00000100:00100000:1.0:1788636949.144072:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226116608 00000100:00100000:1.0:1788636949.144075:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226116608 00000100:00100000:1.0:1788636949.144090:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788636949.144098:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875521226116352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636949.144127:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788636949.144167:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875521226116352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636949.144175:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788636949.144193:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788636949.144200:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226116480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788636949.144210:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788636949.144238:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226116480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636949.144244:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788636949.144255:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788636949.144268:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226116608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636949.144283:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788636949.144311:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226116608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636949.144317:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788636949.144335:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226116992 00000100:00100000:1.0:1788636949.144339:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226116992 00000100:00100000:1.0:1788636949.144362:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226117504 00000100:00100000:1.0:1788636949.144365:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226117504 00000100:00100000:1.0:1788636949.144395:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788636949.144402:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226116992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.144434:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875521226116992:12345-0@lo:400:kworker.0 Request processed in 33us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636949.144441:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788636949.144453:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788636949.144459:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226117504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.144485:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875521226117504:12345-0@lo:400:kworker.0 Request processed in 27us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636949.144492:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788636949.144513:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226118016 00000100:00100000:1.0:1788636949.144517:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226118016 00000100:00100000:1.0:1788636949.144537:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226117120 00000100:00100000:1.0:1788636949.144539:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226117120 00000100:00100000:1.0:1788636949.144550:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226117632 00000100:00100000:1.0:1788636949.144552:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226117632 00000100:00100000:1.0:1788636949.144562:0:20104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226118144 00000100:00100000:1.0:1788636949.144564:0:20104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226118144 00000100:00100000:1.0:1788636949.144578:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788636949.144585:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226118016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.144624:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875521226118016:12345-0@lo:400:kworker.0 Request processed in 40us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636949.144631:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788636949.144644:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788636949.144651:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226117120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.144678:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875521226117120:12345-0@lo:400:kworker.0 Request processed in 28us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636949.144684:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788636949.144696:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788636949.144702:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226117632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.144729:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875521226117632:12345-0@lo:400:kworker.0 Request processed in 27us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636949.144735:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788636949.144748:0:20104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636949.144754:0:20104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf03fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226118144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.144780:0:20104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf03fcce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875521226118144:12345-0@lo:400:kworker.0 Request processed in 27us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636949.144787:0:20104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636949.144864:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226116608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636949.144877:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875521226117120:0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.144888:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fcadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875521226117632:0@lo:400:kworker.0 00010000:00080000:1.0:1788636949.144900:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cf03fccc000 x1875521226118144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636949.144924:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3646:1875521226118144:0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.144943:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226116480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788636949.144953:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef04229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3646:1875521226116992:0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.144961:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf01291aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3646:1875521226117504:0@lo:400:kworker.0 00000100:00100000:1.0:1788636949.144970:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf03fccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3646:1875521226118016:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.145463:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef023fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226116352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636949.145482:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef0362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226116864:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.145517:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636949.145544:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf012918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226117376:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.145578:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636949.145598:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226117888:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.145620:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636949.145641:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788636949.145648:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf00f179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7a34533-966f-4857-8403-9471b802ebf2:3649:1875521226116736:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.145674:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636949.145702:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef035f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226117248:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.145723:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636949.145740:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226117760:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.145759:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636949.145796:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226116864 00000100:00100000:2.0:1788636949.145801:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226116864 00000100:00100000:2.0:1788636949.145850:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226117248 00000100:00100000:2.0:1788636949.145853:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226117248 00000100:00100000:2.0:1788636949.145867:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788636949.145873:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226116864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.145915:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875521226116864:12345-0@lo:400:kworker.0 Request processed in 42us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636949.145922:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788636949.145937:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788636949.145943:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226117248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.145971:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226117248:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636949.145977:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788636949.145993:0:18712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226117376 00000100:00100000:2.0:1788636949.145996:0:18712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226117376 00000100:00100000:2.0:1788636949.146033:0:18712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636949.146040:0:18712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226117376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.146085:0:18712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226117376:12345-0@lo:400:kworker.0 Request processed in 45us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636949.146091:0:18712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636949.146110:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226116736 00000100:00100000:2.0:1788636949.146114:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226116736 00000100:00100000:2.0:1788636949.146139:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788636949.146146:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf027aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:3649:x1875521226116736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.146175:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf027aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c7a34533-966f-4857-8403-9471b802ebf2+24:3649:x1875521226116736:12345-0@lo:400:kworker.0 Request processed in 30us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636949.146182:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788636949.146209:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226117888 00000100:00100000:2.0:1788636949.146213:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226117888 00000100:00100000:2.0:1788636949.146237:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226117760 00000100:00100000:2.0:1788636949.146240:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226117760 00000100:00100000:2.0:1788636949.146254:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788636949.146260:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226117888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.146288:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875521226117888:12345-0@lo:400:kworker.0 Request processed in 28us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636949.146294:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788636949.146306:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788636949.146312:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226117760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.146338:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875521226117760:12345-0@lo:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636949.146344:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788636949.147778:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf00f179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c7a34533-966f-4857-8403-9471b802ebf2:3649:1875521226116736:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.147803:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef035f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226117248:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.147833:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3649:1875521226117760:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.147845:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef0362ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3649:1875521226116864:0@lo:400:kworker.0 00000100:00100000:2.0:1788636949.147857:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf012918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226117376:0@lo:400:kworker.0 00010000:00080000:2.0:1788636949.147870:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9cef033bdc00 x1875521226117888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636949.147881:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef033bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3649:1875521226117888:0@lo:400:kworker.0 00000100:00080000:2.0:1788636949.149946:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788636949.149960:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636949.149965:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636949.149968:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788636949.717137:0:17192:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636950.167488:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636950.167528:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226118272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788636950.167607:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636950.167692:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521226118272 00000100:00100000:3.0:1788636950.167703:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521226118272 00000100:00100000:3.0:1788636950.167766:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788636950.167779:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef035f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226118272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788636950.167833:0:18716:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788636950.167898:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef035f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875521226118272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636950.167905:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788636950.168539:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef040f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3649:1875521226118272:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788636950.294015:0:17238:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788636950.294026:0:17238:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636950.294051:0:17238:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788636950.294059:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788636950.666493:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636950.666562:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.26@tcp (source: 12345-192.168.202.26@tcp) 00000100:00100000:2.0:1788636950.666633:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207158656 00000100:00100000:2.0:1788636950.666647:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207158656 00002000:00100000:2.0:1788636950.666725:0:18717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9cef023fce00 x1875521207158656/t0(0) o4->118080cd-cdb0-45eb-bbf8-8278fafb5be9@192.168.202.26@tcp:436/0 lens 504/0 e 0 to 0 dl 1788636961 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788636950.666739:0:18717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef023fce00 with x1875521207158656 ext(0->8) 00002000:00010000:2.0:1788636950.666747:0:18717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef023fce00 00000100:00100000:2.0:1788636950.666790:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 0 00000100:00100000:2.0:1788636950.666803:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+8:2401:x1875521207158656:12345-192.168.202.26@tcp:4:bash.0 00000100:00080000:2.0:1788636950.667631:0:17200:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636950.667734:0:19786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875521207158784 00000100:00100000:0.0:1788636950.667742:0:19786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875521207158784 00000100:00100000:0.0:1788636950.667799:0:19786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.26@tcp, seq: 31 00000100:00100000:0.0:1788636950.667831:0:19786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef023fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+11:2401:x1875521207158784:12345-192.168.202.26@tcp:16:kworker.0 00000100:00100000:1.0:1788636950.673922:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:118080cd-cdb0-45eb-bbf8-8278fafb5be9+11:2401:x1875521207158656:12345-192.168.202.26@tcp:4:bash.0 Request processed in 7096us (7333us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788636950.673954:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 0 00002000:00100000:1.0:1788636950.673976:0:18717:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9cef023fce00 x1875521207158656/t8589934599(0) o4->118080cd-cdb0-45eb-bbf8-8278fafb5be9@192.168.202.26@tcp:436/0 lens 504/448 e 0 to 0 dl 1788636961 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788636950.673989:0:18717:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cef023fce00 with x1875521207158656 ext(0->8) 00002000:00010000:1.0:1788636950.674001:0:18717:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cef023fce00 00000001:00080000:2.0:1788636950.692539:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1788636950.692564:0:19526:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:1.0:1788636950.692902:0:19786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef023fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:118080cd-cdb0-45eb-bbf8-8278fafb5be9+6:2401:x1875521207158784:12345-192.168.202.26@tcp:16:kworker.0 Request processed in 25080us (26413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636950.692919:0:19786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.26@tcp, seq: 31 00010000:00010000:2.0:1788636950.747637:0:19295:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 44884 lines, 44884 kept, 0 dropped, 0 bad.